Users still seeing Original even after Variation was set to 100%
I am experiencing the following scenario: I have a test that has been running for some time. Initially it was a 50/50 A/B test between an Original and a Variation. After a while it became clear that the Variation performed better, so in order to start taking advantage of the lift while the developers are working on the change, I changed the experiment to show the Variation for 100% of traffic and the Original for 0%. However, some users have been seeing the Original in the timeframe after the move to 100% Variation (consistently until the present moment). This is based on both the Optimizely results dashboard and examples from actual users.
What's going on and is there a way to prevent it?
@SavinaV - experiments persist.
Once a user is placed into the "A" group, they will stay in the A group forever.
Now that you have it set to 100% B group, all *new* users will join the B group.
To accomplish what you want to accomplish, you should clone your experiment and set the B group to 100% in the clone. Then pause the original and start the clone. In this way, all users will now see the B experience.
Analytics and Testing Guru