Rich-text Reply

Getting the organization to take part in generating test ideas

JohnH 09-21-15
Accepted Solution

Getting the organization to take part in generating test ideas

Do you all have any specific tips or tactics to get your whole organization bought into testing? I've read many blog posts from Optimizely about how to prioritize testing ideas submitted by colleagues, but I am curious....how to you motivate people to submit these ideas in the first place? 

Level 2

MartijnSch 09-22-15
 

Re: Getting the organization to take part in generating test ideas

Great question John, in our case it works really wel to come up with an idea and start sharing that immediately on a separate channel in Slack. We usually draw a quick mockup on how it would look like and when we post it we usually get some other ideas on how we could do something similar which provides us with at least with 1-2 variants but also with such other ideas that they qualify as their own test.

Besides that everybody is like usual always able to come up with new tests. As most of your organization usually is involved in coming up with new features or improvements to your product in most cases you could say that they're A/B tests as well.
MJBeisch 09-22-15
 

Re: Getting the organization to take part in generating test ideas

[ Edited ]

Everyone loves free food. I do monthly brainstorming lunch; everyone in the office is invited, but the price of admission is presenting a new testing idea. I'll send out an email about a week in advance, announcing the site that I'm soliciting ideas for. That gives everyone time to prepare their documentation. After the session, I collect all the ideas, add them to the client's testing plan, rank them, and then share them with the client during our weekly meeting.

 

As the session moderator, I try to currate the ideas and encourage new lines of thought. I'll (gently) call people out for leaning on the same test idea across multiple sites, or for regular re-use of test ideas. I also have a documentation template prepared for everyone to use; that makes it easier for information standardization and thoroughness of presentation.

Matt Beischel - E-Commerce Optimization Specialist CohereOne

Level 2
Amanda 09-22-15
 

Re: Getting the organization to take part in generating test ideas

I would actually encourage you to take a look at the slides from the recent San Francisco User Group that @Pauline led. Chris Seaman from Atlassian shared some really great ideas on how to motivate his whole company to get involved in testing. Essentially, his optimization team hands out "kudos" to people who have demonstrated an interest in testing. Autodesk also shared some thoughts on how they were able to transform from a team that does no testing, to a team that gets input from many other teams on ideas. 

 

Check them out here

Optimizely
Debra 09-23-15
 

Re: Getting the organization to take part in generating test ideas

I periodically email online quizzes asking the staff to guess the outcome of our A/B tests. I also created a form in JIRA so anyone in the organization can submit a testing idea. Every form needs an icon so I chose Darth Vader.
Level 2
Pauline 09-24-15
 

Re: Getting the organization to take part in generating test ideas

We had 2 initiatives that have worked very well to generate ideas from everyone in the company:

 

1) Big Test Challenge: one month to submit A/B tests ideas, the ideas selected got Starbucks giftcards, if the test was a winner we gave extra giftcards.

 

What do you have to do? posters in the office, google form to submit ideas, wiki page with the rules of the challenge, lunch & learn about A/B testing

Results: over 150+ ideas submitted

Cost: <$500

 

2) Dogfood: There is a distribution list that people can use to submit any feedbacks about Hotwire. The product team wants every single employee who uses our product to send us feedbacks (positive or negative); it can be bugs, A/B test ideas or feature requests.

 

What do you have to do? We created posters #MakeASplash and put them everywhere in the office. We also gave prizes for the best feedbacks (most detailed/ most constructive / most inspirational / most bold....)

Results: We receive approx 15-20 emails per week, not all of them are optimization ideas but it is a good way to engage employees with your product in general

Cost: free to $$$ depending on the prizes

Product Manager
Level 2
scleveland 09-30-15
 

Re: Getting the organization to take part in generating test ideas

[ Edited ]

We have a file on our network that people can update to add possible test ideas. Then our testing team has meetings weekly to go over those ideas and any others that we come up with

juliofarfan 10-05-15
 

Re: Getting the organization to take part in generating test ideas

We are doing this
Bi-weekly or monthly meetings with Products, MKT and Sales team to talk about prior and upcoming tests. This gives us the hability to talk about new ideas and see if they are looking relevant
Ideas are scored by PIE framework and every week we review next test prioritized by this score and launch them
claire 10-07-15
 

Re: Getting the organization to take part in generating test ideas

One way to get your whole organization bought into testing is to use A/B testing as a way to help your colleagues, boss, etc. solve business challenges they are confronted with. Ask them which questions they need answers to and use A/B testing to provide them with answers. For example, your sales team’s may wonder which value points resonate best with your customers and and get them to buy. You can identify, test and validate your value points using AB Testing.

At WiderFunnel, we use the PIE framework to prioritize these ideas. You can learn more about the PIE framework here: http://www.widerfunnel.com/how-to-prioritize-conversion-rate-optimization-tests-using-pie/
Claire Vignon
Director of Optimization Strategy @ WiderFunnel
Level 2