Validating if I am running my experiment correctly?
I have set up an experiment where I am testing if users are more prone to notice and click on a tag bubble or tag text? I have two goals, one for engagement and one for click. My experieent has been running for 3 days, with about 10K unique visitors -- yet it still says its inconclusive. I realize that could potentially be a possibility, but i am also questioning if I've set things up appropriately. Is there a way to validate the correctness of my experiement?
Most likely the change you are testing is too small to show any significant difference, even after 10k visitors. See my post on the Optimizely blog about neutral/inconclusive results and how to learn from them: http://blog.optimizely.com/2014/10/30/the-problem-
Also, the IP exclusion field accepts Regular Expressions (aka, regex). So you can exclude multiple IP's, for instance, as follows:
The "|" character is an OR operator, as in "this one OR this one." The backslashes are an escaping character to specify that the dots are actually part of the IP, and not a wildcard symbol.