Unbounce Answers/Getting Started with Unbounce/Unbounce User Guide

07 Page Variants and A/B Testing

Jason Murphy
posted this on November 26, 2010 11:42 am

Our landing page templates are built according to high conversion best practices which you can learn more about on our blog (http://unbounce.com/blog). However, testing is key to the development of pages that work best for your customers and maximise your online marketing activity.

After you have created a page in Unbounce, you can test it against other possible strategies by easily creating new variants of that page that you can modify and divert some of your traffic towards. You can then evaluate the effectiveness of the different designs by seeing which page variant converts the higher percentage of the traffic sent to it.

The simplest form of page testing is the A/B split-test. This pits one (‘Champion’) page design against one or more (‘Challenger’) variants of the same design to see which one performs best. All of the page variants appear at the same URL but any visitor to that URL will see only one of the variants, served to them randomly. The conversions for each variant are recorded and then compared to see which page performs best.

Multivariate testing is more complex and requires much higher traffic volumes. If you want to learn more, there is a good article on multivariate testing on Wikipedia here: http://en.wikipedia.org/wiki/Multivariate_testing

 

ab-test-center.png

 


To create a new ‘challenger’ variant of a page and start an A/B split-test:

  1. Go to the page overview screen for the page in question and use the gear menu to select ‘Duplicate this Variant’. 
  2. This creates a copy of the existing variant that you can edit, publish and assign traffic to.
  3. If you want to start your new variant using a blank page, click on the ‘Create a New Page Variant from Scratch’ button.
  4. You can create as many page variants as you like, but since the traffic you receive will be divided between them your ability to get test results may be diminished if you test too many variants in relation to the amount of traffic you are receiving to the page overall.
  5. Edit your new page variants in the Unbounce page editor in just the same way that you edited your original. 
  6. Remember to reselect the conversion goal(s) in each of your new page variants; Unbounce does not replicate the conversion goal setting for a variant when you duplicate it.
  7. Assign weight to your new page variant by clicking on the number in the segment of the ‘weight’ column that corresponds to your new variant and entering the desired percentage. Hit ‘Enter’ on your keyboard (or ‘Return’ if you are using a Mac,) to save the change. 
  8. The weight of the champion variant will be adjusted so that the combined weight of all variants equals 100%
  9. Click on ‘Republish Page’ in the top right of the page details screen once you are ready to send your new page variant live and begin your test.

7.01 Page Statistics and Promoting a Variant

 

Unbounce tracks the traffic to each of your pages and, if you have a conversion goal set, will let you know how well the page is performing.

  • The ‘Visitors’ column in the ‘A/B Test Centre’ area of the page overview screen tells you how many unique individuals have visited your page. 
  • The ‘Views’ column tells you how many times the page has been viewed. 
  • The ‘Conversions’ column tells you how many unique visitors have clicked on your conversion goal.
  • Conversion Rate’ expresses the number of conversions as a percentage of the unique visitors to your page. 


Unbounce will track the conversions for each of your page variants and let you know when they have reached a point where their performance has reached a level where you can be confident that one page is performing better than another (statistical confidence.)

 

promoting-a-variant.png


To promote a variant to champion:

  1. Make sure your page is published and the variant you want to promote has some traffic weight assigned to it: Your page must be published in order for you to promote a challenger page variant to champion.
  2. Use the gear menu corresponding to the variant name in the page details screen. 
  3. Select ‘Promote to Champion’. 

The challenger variant will be promoted to Champion and the old champion will be placed in the ‘Discarded Variants’ area of the A/B Test Center.

Note: When you promote a challenger variant to champion you effectively end the test (your page still works but all the previous conversion stats are no longer relevant.) At this point you should reset your stats by clicking on ‘Reset Stats’ at the right side of your screen.

To delete a page variant, you must first discard it by using the gear menu opposite the variant’s name and selecting ‘Discard This Variant’. You can delete a discarded variant by using its gear menu and selecting ‘Delete This Variant

Discarded variants have had all of their traffic weight removed and are no longer visible to any of your visitors.

You can re-activate a discarded variant by using the gear menu opposite the discarded variant’s name and selecting ‘Make Challenger’.

7.02 Resetting Statistics

To reset your your statistics, access the overview screen for the page in section and scroll down to the A/B test centre. Click the 'Reset Stats' button in the top right of the test centre. This will zero out the statistics for your current test but your lead data will remain intact.

 resetting-statistics.png

 

Comments

User photo
Jason Pruitt

How do you "demote" a champion? 

March 22, 2012 08:40 am
User photo
Ryan Engley
Unbounce

Hey Jason - sorry for the late reply here.  You can't demote a champion but you can replace it with one of your challengers which achieves the same end.  Just click the cog menu next to the variant you'd like to promote and choose "Promote to Champion." 

July 16, 2012 05:03 pm
User photo
Daniel Martinez

Can you edit the letter associated with a variant.  I was hoping to be able to reuse a letter I accidentally discarded.

August 13, 2012 07:56 pm
User photo
Ryan Engley
Unbounce

Hi Daniel - unfortunately not.  The letter is permanently tied to that variant once it's created.  If you need, we may be able to recover the variant you accidentally deleted.  Just open a support ticket and let us know which page and variant letter it was.  We'll be sure to have a look for you.

August 14, 2012 03:08 pm
User photo
Jim Baggins

How do you delete a test lead/s you created yourself?

October 12, 2012 07:37 am
User photo
Ryan Engley
Unbounce

Hi Jim - Unfortunately we don't have an elegant solution for deleting test leads at the moment.  It is a feature we plan to implement though we haven't got a timeline for its release.  You can see the related thread in our Community Forum and, if you like, share your feedback with our development team.  Sorry I couldn't give you the answer you wanted on this one.

October 12, 2012 03:19 pm
User photo
Rose Cobb

Can you view old stats once you have reset the stats?

March 16, 2013 06:48 am
User photo
Jacquelyn Ma
Unbounce

Hi Rose - Unfortunately not. Right now if you reset the stats for a page, the old stats will disappear, which is why I would recommend saving the stats either by screenshot or simply noting it somewhere so that you can refer back to them if you need to. 

March 18, 2013 10:14 am
User photo
India Bello

Hi, i need to test 2 different domain with the same launch page, only the name will change. With the AB test explained here i can test 2 versions of the page but the url will be always the same but i need to test ulr1 and url2. How can i do? thanks

March 24, 2013 06:13 pm
User photo
Jacquelyn Ma
Unbounce

Hi India - If you are testing two different domains with a given page, you will actually need to set this up as two completely separate pages. At this time, each Unbounce page can only be used with one given display URL, so if you are wishing to test a second URL, you will need to make a duplicate of the current page in order to do so. To see the steps for how to duplicate a page, please see: http://support.unbounce.com/entries/342861-08-Duplicating-a-Page-

However, I did want to note that when you have two copies of the page in order to test two different URLs, this would not necessarily be AB testing since there is no traffic weight split. Each page will gather their own statistics and you will need to compare them manually. 

I know this isn't exactly what you wanted to do India, but I hope it helps!

March 26, 2013 11:48 am
User photo
Jeff McKay

Once I create the different Variants and have added in the Google Analytics code to each, how will I be able to tell the pages visits apart within Google Analytics?

April 11, 2013 05:49 am
User photo
Ryan Engley
Unbounce

Hey Jeff - for now you have to tweak the GA code so it knows which variant your visitors have accessed. Good news is that a member of our team wrote the code you'll need and posted it here.

Just copy/paste that code into your landing pages (it replaces your current GA script) but update YOUR-GA-ACCOUNT-IDENTIFIER with your GA account and EXAMPLE.COM with your domain.

That should do the trick.

In GA you'll then see the variant letter appended to the page's URL.

April 11, 2013 12:52 pm
User photo
Colin Stuckert

What is deal with views/visitors....it shows i received 104 hits so im thinking this is 104 original new people but then I look at views and vistiors being similar...what is difference?

May 08, 2013 11:40 am