Rich-text Reply
Topic Options
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
Highlighted
[Email] Subject Line AB Test: question highlighting first person v. second person
Allison 11-14-14
[Email] Subject Line AB Test: question highlighting first person v. second person
[ Edited ]- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Email to a Friend
- Report
Hey all,
I wanted to share a statistically significant email test we ran here at Optimizely. Here is a great article on creating a strong hypothesis: http://blog.rjmetrics.com/2014/07/07/state-your-hypothesis-a-scientific-approach-to-ab-testing/
In spirit of our value of transparencY here, I'll admit that this hypothesis was not articulated best to provide a global learning opportunity. That being said, it provides a great opportunity for us to iterate again!
Test type: Subject line
Goal: Clicks
Control: Are you measuring your tests accurately? Measuring statistical significance of your test
Variation: FAQ: How long should my test run?
Variation won with an increased conversion rate of 33.9%!