Hey all,
I wanted to share a statistically significant email test we ran here at Optimizely. Here is a great article on creating a strong hypothesis: http://blog.rjmetrics.com/2014/07/07/state-your-hypothesis-a-scientific-approach-to-ab-testing/
In spirit of our value of transparencY here, I'll admit that this hypothesis was not articulated best to provide a global learning opportunity. That being said, it provides a great opportunity for us to iterate again!
Test type: Subject line
Goal: Clicks
Control: Are you measuring your tests accurately? Measuring statistical significance of your test
Variation: FAQ: How long should my test run?
Variation won with an increased conversion rate of 33.9%!
