Rich-text Reply

Far too many visitors being reported for 'A' Variant

PeterKelly 12-09-16

Far too many visitors being reported for 'A' Variant

[ Edited ]

 

HI

 

I've a test running - but the system is reporting way too may vistiors than is possibe for the 'A' varient.

 

I have set a 50/50 traffice split and using Hotjar to view user behaviour -  this it seems is what I'm getting.

 

Optimizelt reporting  about 5 times as many visitors to the "A" varient than Adwords is telling me I've had clicks.

 

 

This was the case when the optimizely code was on all pages.

 

I tried removed from all pages but the landing pages and confirmation page - but the reuslt was the same.

 

 

I've ran vary simialr tests on a very simialr websites recenty - no technical differences; only branding and copy differences.

 

A is http://getoutofdebt.co.uk/debt-relief-orders/lp/

B is http://getoutofdebt.co.uk/debt-relief-orders/lp2/

 

Any Ideas?

 

 

regards

Peter

RyanC 12-09-16
 

Re: Far too many visitors being reported for 'A' Variant

I would use Google Analytics to measure the number of users. And please do keep in mind that there might be discrepancies between them, but 5x is too much.

Optimizely has the following tutorial on how to integrate Google Analytics with an Optimizely experiment - https://help.optimizely.com/Integrate_Other_Platforms/Integrating_Optimizely_with_Google_Universal_A...
Ryan
------------------------------------------------
The best solution is the simplest.
Level 11
PeterKelly 12-09-16
 

Re: Far too many visitors being reported for 'A' Variant


Google Analytics; Adwords and Hotjar are all reporting correctly.

Optimizly is not.

That's my issue.

regards
Peter




RyanC 12-09-16
 

Re: Far too many visitors being reported for 'A' Variant

Check the metrics you are using in Google Analytics; Adwords and Hotjar and make sure the audiences and url targetting set in Optimizely match the filters set in the other platforms.
Ryan
------------------------------------------------
The best solution is the simplest.
Level 11
robertchan 12-09-16
 

Re: Far too many visitors being reported for 'A' Variant

Have you read this article? https://help.optimizely.com/Get_Started/Frequently_asked_questions_in_Optimizely_Classic#How_does_Op...

Also, I don't think you mentioned, but are you running the same experiment multiple times? This could have an effect on the number of visitors hitting your experiment. If neither of these are of help then I'd recommend reaching out to Optimizely support.
Robert Chan

PeterKelly 12-13-16
 

Re: Far too many visitors being reported for 'A' Variant

This was solved by optimizly support.

The issue was junk traffic all coming from one IP address.