Rich-text Reply

Newly add hover state results in less engagement

Chobit 12-10-14

Newly add hover state results in less engagement

Hallo,

 

my team and I are having problems interpreting the results of a hover test. We think something went wrong, because the results make no sense. We changed the result list to check if a hover has a positive effect on the click rate, but the results are in general that we have less engagement by -4.5%, a lower click rate on the result item itself -5,3% and less pagination -2,6%. 

 

Has somebody some advice regarding the setup of a hover test? Or can somebody think of an explanation why the hover effect leads to a negative result?

 

Best,

chobit

Level 1

greg 12-10-14
 

Re: Newly add hover state results in less engagement

Hey Chobit, can you share the sample size and duration of the test? How much "chance to beat baseline" does Optimizely show?

If a sample size isn't large enough, it's common to see differences in goals that may not make sense. These are mostly random fluctuations, and not directly attributable to the change you're testing.
Level 2
jeantemp 05-09-16
 

Re: Newly add hover state results in less engagement

Hey Chobit -
here is an intesting article on hover and CTR by google.
http://www.simpleusability.com/beinspired/2011/01/mouse-eye-tracking-how-useful-is-it/
Level 2