Introducing The Optimization Methodology Series! Available within the Knowledge Base

by Optimizely ‎01-06-2016 January 6, 2016

Happy New Years, testers! Thanks to the efforts of our Strategic Consultants, Solutions Architects, and Education team we've made a big push for scalable optimization methodology articles. The greater list will be continuously updated in the following link:


For now I'd like to highlight some of the newer, specific articles that have been recently released:


Identify skills and competencies for your optimization team

  • Build a well-rounded optimization team that is visible, sustainable, and efficient
  • Consider which hard and soft skill sets your team needs when you are hiring, expanding internal resources, or considering working with a Solutions Partner

Use direct data to inform ideation

  • Build a business intelligence report
  • Use direct data to generate strong hypotheses
  • Consider how to use multiple data sources together

Create a business intelligence report to drive ideation

  • Build a business intelligence report based on multiple data sources
  • Generate hypotheses for testing and personalization

Create an individual test design and plan

  • Design and scope an effective experiment
  • Create a basic or advanced experiment plan for an individual test
  • Communicate your plan to external stakeholders, including designers and developers 

Define primary, secondary, and monitoring goals

  • Define testing goals for quick wins and long-term gains
  • Set primary, secondary, or monitoring goals
  • Create experiment and campaign goals that support your broader program metrics
  • Set different types of goals across digital commerce, travel, and media funnels

Interpret Your Results

  • Interpret the results of winning, losing, and inconclusive experiments
  • Segment by audience for a granular view of customer behaviors
  • Evaluate how the the results of this test affect other valuable revenue streams
  • Gather sufficient data before deciding to stop an experiment

Take Action Based on Your Results

  • Turn your experiment results into future action
  • Build on top of winning variations and set them live from the Results page
  • Learn from losing variations
  • Iterate on inconclusive experiments

Share Your Test Results With Stakeholders

  • Communicate the results of your tests and campaigns with others in your organization
  • Focus on what to share: what your team has learned and how you’ve made an impact
  • Plan when to share: the cadence that’s best for different stakeholders
  • Use different formats and templates to communicate results