Rich-text Reply

[Email] Subject Line AB Test: question highlighting first person v. second person

Allison 11-14-14

[Email] Subject Line AB Test: question highlighting first person v. second person

[ Edited ]

Hey all,

 

I wanted to share a statistically significant email test we ran here at Optimizely. Here is a great article on creating a strong hypothesis: http://blog.rjmetrics.com/2014/07/07/state-your-hypothesis-a-scientific-approach-to-ab-testing/

 

In spirit of our value of transparencY here, I'll admit that this hypothesis was not articulated best to provide a global learning opportunity. That being said, it provides a great opportunity for us to iterate again!

 

Test type: Subject line

Goal: Clicks

Control: Are you measuring your tests accurately? Measuring statistical significance of your test

Variation: FAQ: How long should my test run?

 

Variation won with an increased conversion rate of 33.9%!

 

Optimizely