Using A/B Test features

Be careful: This is advanced! If in doubt, consult with your Success Engineer to see if the below information is pertinent to your use-case.


Fundraise Up offers basic A/B Testing software at no cost. It allows you to split specific content (links, text, color, etc.) across your website traffic - essentially showing your donation form to 50% to visitors, and Fundraise Up donation checkout experience to the other 50%.

 


Restrictions

As a result of the extreme simplicity and speed, this feature does have some limitations:

  • You must have access to HTML code of your website to use this feature. There is no visual interface/dashboard/GUI to setup the test.
  • We can only split traffic in two equal parts. Unfortunately, we cannot change proportions of splitting or add some control branch for test (e.g. 33%/33%/33%).
  • For integrity, we do not use our backend to split traffic and do it completely in the visitor's web browser. We use precise math and randomization to accomplish this, so we cannot guarantee absolutely accurate distribution for small traffic (under 1,000 visitors). However, performance is fast and accurate on websites with over 1,000 visitors daily.

 


How to use it

There are a couple of options for running a test.

Basic usage

As mentioned above, you must have access to html code of your website or particular page. We use html data-attributes to define the test name and each variant of content.

Imagine you want to decide what text on a Button Element could bring you more money. You would create two equal Button Elements, each with their own label text (i.e. "Give" vs "Donate"), and put something like this to the HTML of your website:

<div data-fun-test="Button Text" style="display: none;">

<!-- Variant 1 -->
<div data-fun-variant="Give">
<a href="#XXXXXXXX"></a>
</div>

<!-- Variant 2 -->
<div data-fun-variant="Donate">
<a href="#YYYYYYYY"></a>
</div>

</div>

There are only two terms you need to know.

  • data-fun-test — this parameter defines the name of your test.
  • data-fun-variant — this is the definition of each variant.

Once a webpage loads, we randomly decide what variant of the Element will be shown to a visitor. We show the content of selected html tag and hide the content of other one.

Two independent blocks

You can use both data-fun-test and data-fun-variant in different places of your webpage:

<!-- Variant 1 -->
<div data-fun-test="Button Text" data-fun-variant="Give" style="display: none;">
<a href="#XXXXXXXX"></a>
</div>

<!-- Variant 2 -->
<div data-fun-test="Button Text" data-fun-variant="Donate" style="display: none;">
<a href="#YYYYYYYY"></a>
</div>

 


Outcome

After a short period of time, you will be able to compare the results of the two campaigns and decide which one is better.