Ideas to get VP's and other business stakeholders to buy into a culture of optimization testing?
At my company we seem to have a fear of testing. The fear is that the testing will cause a loss in lead generation and thus is not a good idea. Any ideas on how to get them to jump in the testig pool and see what happens and put their fears aside?
baconipsum.com - because everyone need
a little bacon in their text!
Optimizely X Web Foundation and Technical Foundations Certified.
I lean to agree with what MartijnSch had said. That the risk of not testing is bigger to not test. Our sites aren't perfect. If we think that everything we do is exactly what our customers want, we are simply foolish. You can always improve, you can always do better. If you don't try anything, yes you probably won't hurt the business, but you will never grow the business. At least with testing, you have unbias testers that are telling you what they like and don't like based on their behaviors.
One of the things we did when we first started testing and getting our VP & CEO on board was, track everything. That way we could see the big picture of what was being affected by any changes.
Plus we met about what tests we wanted to run and weighed the risks. For example if we were running a test on our cart area. At first it's kind of scary b/c that's how we make money, if we deter people from there, sales suffer. So we scaled back the amount of traffic, knowing that it would take longer to get a statistical winner. But at least they were willing to do it. We also did smaller tests with smaller changes to get them used to the process, reporting, etc. When they started to see positive results, or even when they were down how easily it was to stop a test. They were more likely to do more tests.
Ultimiately, everything came down to the data and results. The biggest things they wanted to make sure was that our site conversion didn't drop. I always had to to know where our site conversion was at, and if it dropped due to the test to stop it and rethink.
It sounds like they really are afraid about loss and control. You can address those in different ways.
Minimize potential for loss...
Losing leads can be a very big deal, so it's important not to minimize that fear. One idea is to solve something that everyone agrees is a problem already, rather than trying to improve what they already believe to be working well (or are afraid to risk losses on). For example, if everyone agrees that a particular channel of traffic is performing poorly relative to others, you may be able to run a test there, to see if you can get a lift in results.
Provide confidence in controls...
Try to get an example of the scenarios they are afraid of. Referencing those scenarios, explain the different ways you have to control who sees the experiment, how you can turn it on or off, the kind of data you have to make decisions, etc.
Revere.ai Monitor your Optimizely experiments