Rich-text Reply

Winning goals

shirley 08-19-14

Winning goals

I've been wondering about this and have yet to find what I'm looking for.

 

When I have an experiment running, and a goal is reached, is there somewhere I can find a record of when that goal was reached? We had a goal reached yesterday for several hours in the afternoon. This morning it is back down from 97% to 79. However, I don't see any record of the fact that the goal was reached yesterday and what percent and how long. I would imagine I might have missed other instances if I wasn't logged in and checking.

 

I'd like to see somewhere in the results panel I can review all the instances of when a goal was reached.

 

 

Level 2

adzeds 08-20-14
 

Re: Winning goals

This is an interesting one because if the goal has been reached and then fallen away again you don't have a winning test.

Maybe there could be a marker on the graph for points when Optimizely thought the variation was winning with 95%+ confidence.
David Shaw
Level 11
shirley 08-20-14
 

Re: Winning goals

[ Edited ]

So nothing exists then as far as you know either?

Level 2
Amanda 08-20-14
 

Re: Winning goals

Hey @shirley - this does not exist quite yet, however I would recommend adding it as a product ideas on our board

 

Also, if you have not already, I recommend reading our article on how long to run a test.  It can definitely happen that your test will reach statistical signifcance temporarily due to chance, but if you do you have ample visitors, it may change (as seen in the swing of your percentage). My recommendation would be to hang tight and let your experiment continue running. 

 

Let me know if you have any questions on this! 

Optimizely
shirley 08-20-14
 

Re: Winning goals

That's what we do. But it'd help to know it's going up and down or if it actually did hit goal. It's pertinent information in my opinion.
Level 2
Amanda 08-20-14
 

Re: Winning goals

Agreed on it being pertinent! Our product managers review the ideas board each month and we're always looking to revamp the results page. Thanks so much for posting.
Optimizely
MJBeisch 08-20-14
 

Re: Winning goals

[ Edited ]

You can view the "Chance to beat baseline" over time on the results page. There's a dropdown at the top of the graph for each goal that allows you to select different data points to show in the graph. Here's a screenshot pointing at the dropdown:graph-dropdown.jpeg

 

And here's what the graph of the Chance to Beat Baseline looks like for that goal. Note that the goal reached a high confidence level after about a week but then dropped off and then never again got higher than 75% or so:

 

confidence-reached.jpeg

Matt Beischel - E-Commerce Optimization Specialist CohereOne

Level 2
shirley 08-20-14
 

Re: Winning goals

Thanks Matt, yes I do look at that, but I specifically want to know when/how often goal is reached.
Level 2