Rich-text Reply

Is a customer able to manipulate the split testing?

jannis5 01-17-17

Is a customer able to manipulate the split testing?

Hi people :-)

 

i m pretty new in the game and i have a few questions.

 

First of all: The idea of split testing is that different customers will get access to different sale pages (based on individual criterias) even if they used the same link, isn't it?

 

So can i also use "optimizely" to create a kind of "random raffle system" so that only a few customers (clicking the sale link) will be able to get access to a "main sale page" while others will not? For example if i don't have enough products for everyone (e.g. there are 100 interested people, but i can only sell 10 products).

 

If that is possible (and i guess it is!?) here's my most important question: Is customer X (one of the 100 interested people in my example) able to manipulate or "hack" the system by himself so that he gets a safe access to the main sale page (to buy one of the 10 products before others can) in a way? How could he do that?

 

Thank you in advance - and excuse my bad english skills :-)

Level 1

RyanC 01-17-17
 

Re: Is a customer able to manipulate the split testing?

That's one way of seeing it. You can also manipulate the existing page, for example include a banner with the discount code ... this is called the variation. So when the experiment is launched, you will have visitors being bucketed randomly to the original version, and the variation version of the same page (same url).

In Optimizely you can control the amount of traffic you want the Experiment to be shown to your visitors, to all (100%) or maybe to the few (10%) .... you can also control the percentage on how Optimizely randomizes visitors between the Original and Variation, by default it's 50/50.

Can visitors hack the system? Very rare for the normal customer to be an Optimizely guru to guess and waste time hacking into the site to view different variations.
Ryan
------------------------------------------------
The best solution is the simplest.
Level 11
JasonDahlin 01-18-17
 

Re: Is a customer able to manipulate the split testing?

"Can visitors hack the system? Very rare for the normal customer to be an Optimizely guru to guess and waste time hacking into the site to view different variations."

Though presumably true, to answer the question directly, "Yes, a person can hack the system".

Since everything Optimizely does is via JavaScript which is now and always has been 100% exposed to the end-user, it is quite simple for anyone who knows JavaScript to walk through your Optimizely variations to see what each variation does and which URLs it applies to.  It is also quite simple for the user to switch from one variation to another.  Also, you should always consider that one of your competitors may be actively reviewing your site to see what you are up to (there are only 3-4 client-side A/B platforms in common usage and it's fairly simple to learn the basics of each of them making it relatively easy for me to keep tabs on our competition (and they on us)).

 

--Jason Dahlin
Analytics and Testing Guru Smiley Happy

Re: Is a customer able to manipulate the split testing?

As they said, (@RYN004 and @JasonDahlin ) if the snippet code is available from the source code, everyone with the knowledge and the skills can manipulate it.

But I don't think someone with the skills and knowledge, waste his time manipulating a redirect experiment. Probably he has a lot of things to do before playing with your website.
SEM and CRO Specialist