Is it possible to see how stats engine obtains its results through an example calculation?
As the subject says, I would like to reproduce the result of an experiment using the Stats Engine's mathematical calculations with the results we have gotten.
The example experiment would have the following data:
Visitors: 553 613
Conversions: 370 445
Conversion rate: 66.91% 72.59%
We got Optimizely telling us that the variation was only 46% significant, when we had a default significant threshold of 90%.
Can anyone please, using the example above, write down the mathematical process of how we can come to a significance of 46% ? using the constants or variables from the technical report (Stats Engine Technical Report), what should our α, τ and k be?