Rich-text Reply

Userd see different versions of a test even in one session

mtg 05-18-16
Accepted Solution

Userd see different versions of a test even in one session

The problem arises when a user is opening more than one tab. Every tab has a different version of a test. This is a big problem for us as in our business it is often behavior. How can i improve this? 

mtg
Level 2

JasonDahlin 05-18-16
 

Re: Userd see different versions of a test even in one session

hi @mtg,

 

What you describe is not the way Optimizely works.  Experiment and Variations persist across browser sessions using cookies.  Unless a user clears their cookies (or uses a different device or different browser on the same device), they will see the same experiments and variations in each new tab.  If a user opens a new Private/Incognito window, they will see a new experience because their old cookies do not exist in the new browser window.

 

Can you describe your situation in more detail?

--Jason Dahlin
Analytics and Testing Guru Smiley Happy
Experimentation Hero
mtg 05-19-16
 

Re: Userd see different versions of a test even in one session

hi @JasonDahlin
Ok - I found the reason. When new user opens more than one tab with a page where the test is active, on every page he can see a different version. After that it is ok.

MTG
mtg
Level 2
JDahlinANF 05-19-16
 

Re: Userd see different versions of a test even in one session

@mtg, If a user opens multiple tabs/windows at the same time, such that the 2nd window loads and starts processing the Optimizely snippet before the 1st tab has completed processing it (creating the entires in the cookie that store the experiment/variation assignments), then it is possible that the 2nd tab will be assigned a different variation than the 1st tab.  However, whichever tab is the last to process this allocation before the cookies are set will be the tab that sets the variation that will be used for all tabs on all subsequent page hits.

 

e.g.

If these three things happen at the exact same time:

Tab 1 loads, does not see a cookie, so picks variation A

Tab 2 loads, does not see a cookie, so picks variation B

Tab 3 loads, does not see a cookie, so picks variation B

 

 

Let's presume Tab 3 is the last one to write to the cookie.  So now, the user is assigned to variation B.

If the user refreshes each tab/window, they will now see variation B in each tab/window because when that tab/window loads, it will see the cookie already contains a variation assignment.

mtg 05-19-16
 

Re: Userd see different versions of a test even in one session

This is exactly what we observed! Thanks!
mtg
Level 2