New in the Knowledge Base - New Testing Strategy Material, Account Settings, and Audiences

by Optimizely ‎09-23-2015 September 23, 2015

Happy Hump Day everybody! It's been a bit longer than usual since our last update of the newest content available within our knowledge base. We've got some great new material for your consumption to help with testing strategy, managing your account settings, as well as Audience conditions.


Testing Strategies

Creating a Testing Charter To Guide Your Optimization Program

by Ryan Lillis, Strategy Consultant

  • Understand the purpose of a testing charter
  • Decide what is important to include in your charter
  • Build your own testing plan using our starter template


Prioritize Your Test Ideas and Build a Roadmap

by Amy Herbertson, Technical Support Representative

  • Identify the right prioritization framework for you
  • Organize your list of test ideas from first-to-run to last
  • Create a meaningful timeline for running your experiments
  • Implement a process that prioritizes your test ideas automatically


Account Settings

Project Settings: JavaScript / jQuery

by Ehsan Mafi, Customer Education Manager

  • Manage settings in the JavaScript subtab of your Project Settings.
  • Change the version of jQuery included in the Optimizely Project Code
  • Use Project Javascript to insert custom JavaScript that runs before the Optimizely snippet, without having to make direct changes to your site's code


Project Settings: Privacy

by Ehsan Mafi, Customer Education Manager

  • Manage settings in the Privacy subtab of your Project Settings
  • Anonymize IPs, mask descriptive names, force parameters, draft/paused experiments, and other information for additional privacy
  • Filter IP addresses from Optimizely results
  • Understand tradeoffs between additional privacy and integrations/compatibility


Audiences and Other Test Set-up

Audiences [Update]

by Nils Van Kleef, Technical Support Representative

  • Determine which visitors can be included in an experiment based on certain qualities about them
  • Create new audiences in Optimizely or add existing ones to your experiments
  • Build audiences using conditions or custom code


Audience Conditions [Update]

by Nils Van Kleef, Technical Support Representative

  • Use Audience conditions to customize who will be included in your experiments, such as: 
    • Visitors who use certain devices, like phones or tablets
    • Visitors in certain locations
    • Visitors who come from certain ad campaigns or who use certain query parameters
    • Visitors who have certain cookies, like logged-in


Mutually Exclusive Experiments [Update]

by Ehsan Mafi, Customer Education Manager

  • Decide whether to run mutually exclusive experiments, or run simultaneous or sequential experiments
  • Run multiple tests on the same page or flow simultaneously, keeping the audiences mutually exclusive
  • Evaluate the effect of single or controlled changes on your conversion rates
  • Avoid skewing the results of one test by running another simultaneously
  • Establish groups of experiments to be mutually exclusive among themselves but not the rest of your experiments