Split⚡️Split

SplitSplit is a tiny A/B testing framework for Rails.

Define an experiment like this:

<% split_test :welcome_speech do |speech| %>
  <% if speech.with_pictures? %>
    <%= render 'welcome_speech' %>
  <% else %>
    Welcome!
  <% end %>
<% end %>

And you'll get this:

Welcome speech 
  Visited landing page -> [Track this differently]
    with pictures -> 30% signed up
    control group -> 10% signed up
  [Add a different graph for this experiment]

But first, don't forget to mark important events in your app:

<%= track.funnel_started %> <!-- defaults to name='Visited landing page' -->
<%= track.funnel_finished %> <!-- defaults to name='Signed up' -->
<%= track.intermediary_point 'Payment' %> <!-- outputs "<script>ahoy.track('Payment')</script> -->

Installation

Visitor tracking is provided by Ahoy. If you want to chart the results like in example above, install Chartkick gem.

gem 'split_split'

Usage

Let's say, we've made two versions of our landing page and can't decide which one is better.

1. Collect the data

We've put our two versions into separate files: landing_page_visual.html.erb and landing_page_textual.html.erb. Head into the controller action that renders the landing page and insert split_test there.

def landing_page
  split_test :landing_page, [:visual, :textual] do |variant|
    render "landing_page_#{variant}"
  end
end

2. Display results

Wherever you want to display results, write this:

<% SplitTestResults.new(:landing_page).success_rates.each do |variant, rate| %>
  <%= variant %> --> <%= "#{rate.to_i}%" %>
<% end %>

It assumes that each visit was tracked as an Ahoy::Event named Visited landing page and each sign-up named Signed up. If you want to track different events, specify them:

SplitTestResults.new(:landing_page, start: 'Visited', finish: 'Purchased').success_rates