Oli Gardner
posted this on October 21, 2010 05:22 pm
A/B testing has the ability to make marketing super fun. Instead of arguing over messaging or creative – try more than one idea simultaneously and turn it into a contest.

Starting with a copy of your existing page is the easiest way to start a test.
The basics of A/B testing are that you run different versions of your page – called variants – side by side with a series of changes in each variant. The idea is to see which one converts the best.
You can run as many variants in your test as you like (e.g. an A/B/C/D/E/F/G… test) but the more variants you have, the more traffic you need to send to your campaign to be confident that the statistics are not a coincidence.
To create a variant:
That’s it! You now have 2 page variants that you’ll use as the basis for your test.
Now we need to decide what you’re going to change on your new page variant. Here are a few suggestions of page elements that are worth testing:
You can change just one thing or change many at once to create a completely different page.
Changing many things at once might produce a more dramatic change in conversion, but will provide you with less causal information than just trying one thing at a time. It’s totally up to you.
Now that you’ve decided which page elements you want to test, you need to think about *how* to change them to give you a conversion lift.
Looking at the list of elements in Step 2, you could try some of the following things:
Successful manipulation of emotional and physical response is your key to conversion success. By utilizing some principles of design you can start refining your pages.
For more design ideas check out this blog post: Designing for Conversion – 8 Visual Design Techniques to Focus Attention on Your Landing Pages
Now that you’ve created one or more new page variants you need to start the test. To begin your A/B test follow these steps:
Note: When a visitor first accesses your page, we deposit a cookie on their machine to track the view and the variant they saw. As long as that cookie is present when the visitor returns, they will continue to see the same variant. The same goes for you visiting your own page.
Comments
In my Actos campaign I have 4 variants but for some reason the Actos Final 4 variant is not getting its 1/4th share on the impressions.
In setting up a test of a landing page (existing vs. new), how do I measure the difference between the performance of the two pages. Can I set up a conversion trigger, like in Google/Visual Website Optimiser? What could this conversion trigger be? A click-though to the next page, an order, a completed enquiry page, etc. Would be good to understand how you can compare the performance of your two (or more) landing pages?
Thanks