Significance calculation for third-party metrics?
I got some metrics from a third-party tool that are a relevant goal for a running test (number of app installs). Now these numbers are not available within Optimizely, so I have to do the math myself. For this I found the VWO Testing Significance calculator to be helpfull which gives me p-value and significance (yes/no). But actually I also would need the difference interval (like we have it on the Optimizely results page) - or to get those numbers somehow imported into Optimizely.
Any ideas? Experiences?
A/B Split Test Significance Calculator
Thanks for your question! You can have a look at this page for tracking offline conversion events with Optimizely: https://help.optimizely.com/hc/en-us/articles/2000
A caveat is that you'll need to add .the user_id to offline conversions, otherwise Optimizely will count them as anonymous (new) visits. This might skew your current experiment data since it could add a lot of new visitors that haven't converted on any of the other goals. You can also add this data anonymously to a new experiment to make sure this data and your current experiment data don't cause duplicate visitors.
Does this answer your question?
Hi hv, what you could do here is add other visitors by sending as many extra conversion events you need to get there. You should be able to add another event name than that goal, so that it doesn't count as a conversion for the goal you're looking to measure. I hope that makes sense!