Rich-text Reply

Rolling Up A/B Tests on Multiple Low Traffic Pages

JimNathan 08-25-15

Rolling Up A/B Tests on Multiple Low Traffic Pages

We are Optimizely newbies, I hope you will look past that Smiley Happy

 

We have just relaunched our site, which is a travel agent finder service.  I'd like to test different treatments of our agent profile pages, such as this one http://www.vacation.com/travel-agents/usa/?name=anita-carson/27259

 

However, we have thousands of profiles and none of them individually gets enough traffic for a statistically significant test.  Is there a way to efficiently place the same test code on hundreds of different profiles and roll up the results to achieve statistically significant results.

Vice President, Marketing | Vacation.com & Travel Leaders Leisure Group
1650 King St., Suite 450 | Alexandria, VA 22314 | (p) 703.740.4314
jnathan@vacation-corp.com
brianlang 08-25-15
 

Re: Rolling Up A/B Tests on Multiple Low Traffic Pages

Assuming all agent pages follow the same page template, URL structure, and you want to test the same type of changes across all of these pages, simply put the Optimizely script on all of the agent pages and use Substring Match URL targeting with the common URL pattern shared across all pages (ie, with the example URL you provided I would expect www.vacation.com/travel-agents/ to be contained in all individual agent page URLs).

Read more here: https://help.optimizely.com/hc/en-us/articles/200040835-URL-Targeting-Choose-where-your-experiment-r...
Brian Lang
twitter.com/cometrico
ishaan 08-26-15
 

Re: Rolling Up A/B Tests on Multiple Low Traffic Pages

Hi Jim,

In the URL targetting you can use substring match and put in the URL part that is common among all pages. If there are slight variations amongst all URL you can try Regex match too. 

Try this link: https://help.optimizely.com/hc/en-us/articles/200040835?utm_source=product&utm_medium=url_targeting_...

Level 2
JimNathan 08-26-15
 

Re: Rolling Up A/B Tests on Multiple Low Traffic Pages

Thanks Brian, exactly what I needed
Vice President, Marketing | Vacation.com & Travel Leaders Leisure Group
1650 King St., Suite 450 | Alexandria, VA 22314 | (p) 703.740.4314
jnathan@vacation-corp.com
eOps 08-29-15
 

Re: Rolling Up A/B Tests on Multiple Low Traffic Pages

Jim,

We did several of these types of tests for a different vertical and agree with the URL targeting mentioned in the other answers. One thing you might also want to consider is to put a custom tag related to the state or region these individuals fall within. We hook all our experiments to Google Analytics and found there to be some definite differences in trends on a geo level, so after running several experiments, we also started to group these into 4 regions based off the custom tags. I'm not sure how much traffic you are dealing with but it's a great way to think forward for continuous optimization.

All the best!
Level 2