Userd see different versions of a test even in one session
The problem arises when a user is opening more than one tab. Every tab has a different version of a test. This is a big problem for us as in our business it is often behavior. How can i improve this?
Solved! Go to Solution.
What you describe is not the way Optimizely works. Experiment and Variations persist across browser sessions using cookies. Unless a user clears their cookies (or uses a different device or different browser on the same device), they will see the same experiments and variations in each new tab. If a user opens a new Private/Incognito window, they will see a new experience because their old cookies do not exist in the new browser window.
Can you describe your situation in more detail?
Analytics and Testing Guru
@mtg, If a user opens multiple tabs/windows at the same time, such that the 2nd window loads and starts processing the Optimizely snippet before the 1st tab has completed processing it (creating the entires in the cookie that store the experiment/variation assignments), then it is possible that the 2nd tab will be assigned a different variation than the 1st tab. However, whichever tab is the last to process this allocation before the cookies are set will be the tab that sets the variation that will be used for all tabs on all subsequent page hits.
If these three things happen at the exact same time:
Tab 1 loads, does not see a cookie, so picks variation A
Tab 2 loads, does not see a cookie, so picks variation B
Tab 3 loads, does not see a cookie, so picks variation B
Let's presume Tab 3 is the last one to write to the cookie. So now, the user is assigned to variation B.
If the user refreshes each tab/window, they will now see variation B in each tab/window because when that tab/window loads, it will see the cookie already contains a variation assignment.