If I have traffic allocation set to 50%, shouldn't the visitors be almost equal? Does that take a little while to even out (I just started 3 days ago).
Also, is it safe to assume that Bounces are the opposite of Engagement?
Yes, the number of visitors should be about equal, but it may not be exactly equal. It's like flipping a coin: If you flip 10 times you're not always going to get 5 heads and 5 tails... But the more you flip (ie, the larger your sample size), the closer you'll get to a 50/50 split.
You're correct about bounces and engagements; they're exact opposites.
Hi, I'm having a problem with this as well. I understand that it won't be exacly 50-50, but some of my current experiments are seeing splits of 80-20 even though the settings (for A/B testing) are set to 50-50.
What do you think is the cause of this?
How long have the experiments run? What's the total sample size (users tested) and sample size per variation?
If the sample size is >1,000 and you're still seeing an 80/20 split despite having it set to 50/50, then there could be some issue and hopefully someone from Optimizely can check it out.
just one idea and something i myself experienced in earlier times. Is the experiment setup completely new or do you have modified one, which already existed and which already bucketed users into variations before?