Rich-text Reply

Is it possible to see how stats engine obtains its results through an example calculation?

Steeve 12-08-16

Is it possible to see how stats engine obtains its results through an example calculation?

As the subject says, I would like to reproduce the result of an experiment using the Stats Engine's mathematical calculations with the results we have gotten. 

The example experiment would have the following data:
                           Original                                Variation 

Visitors:                553                                     613

Conversions:        370                                     445

Conversion rate:  66.91%                               72.59%

 

We got Optimizely  telling us that the variation was only 46% significant, when we had a default significant threshold of 90%.

 

Can anyone please, using the example above, write down the mathematical process of how we can come to a significance of 46% ? using the constants or variables from the technical report (Stats Engine Technical Report), what should our α, τ and k be?

Level 2

robertchan 12-08-16
 

Re: Is it possible to see how stats engine obtains its results through an example calculation?

You can try using a calculator like this one provided by Optimizely: https://www.optimizely.com/resources/sample-size-calculator/
Robert Chan

Experimentation Hero
Steeve 12-09-16
 

Re: Is it possible to see how stats engine obtains its results through an example calculation?

[ Edited ]

Hi,

 

The link you provided did not answer any of the desired questions.

 

Level 2