Share your Idea
Sort by:
New Idea

Additional Options on "New" Results Page


The new results page is a great step-up visually from the old results page, but a few basic features are missing that would be nice to have (in priority order):

 

1. Adjust time displayed.  Similar to Google Analytics, it would be great if I can easily adjust the time period that shows up to correct for any implementation issues, site issues, etc.

2. Email the report.  I swear this was demoed at Opticon and is probably in the pipeline, but I can't find it anywhere. 

3. Comments: Before I send the results to leadership, I'd like to add comments at the top (key findings) as well as comments with each graph.
4. Option to Add Images from Test: To make this report even more compelling, it would be great to be able to add images of each variation tested.

Ability to Pause Experiment on Results Page

Status: Done
by Allie ‎04-18-2014 April 18, 2014
I would love to be able to pause an experiment from the results page instead of needing to hit "Edit Experiment" and waiting for the full page to load.
Status: Done

Folders on Dashboard

Status: Done
by salismat ‎07-03-2014 July 3, 2014

Please, please please can you put some folders on the dashboard? I don't want to have to implement a new code snippet every tme I want to put things in a folder. Really simple idea but would be fantastically useful. 

 

Once you have run over 30 tests you want to be able to quickly find the ones you are working on creating and the ones that have completed. Its a waste of time to scrolling up and down the page. This is particularly acute when you are trying to present your wizzy new tool to the Marketing Director and you can't find the things you need.

 

Thank you

Matt

Status: Done

Statistical Test Choice & Power Analysis

Status: Done
by jweinstein Level 2 ‎04-16-2014 April 16, 2014 - edited ‎04-16-2014 April 16, 2014

Choosing Statistical Test: 

It would be helpful if there were different statistical tests to choose from when looking at the results. We generally use two-tail tests, so we take the numbers of visitors and conversions and run the results in R.

 

Power Analysis: 

This would  tell the user what kind of effect size he or she could expect to be able to observe given the traffic so far (or how many additional visitors will be needed to reach a certain confidence level).

Status: Done

With our new Stats Engine, Optimizely now uses sequential hypothesis testing with false discovery rate controls to calculate statistical significance. This means that the p-value that you see is a valid measure of statistical significance at all times that your experiment is running.

 

As for power, there is no longer a need to consciously set statistical power. Instead the specificity of your results depends only on how long you are willing to wait. The sequential test we implemented is a test of power one, which means it will detect a non-zero effect size always, if you wait for enough samples. Waiting longer on any test gives you more chance to detect a winner or loser, if one exists. Plus, instead of the effect size you can expect to detect with power given your traffic so far, we now give an in-product estimate of how much more traffic you need to call your test significant given the currently observed effect size stays the same.

We end up doing an unecessary amount of custom events to get around timing of elements being in the dom and/or needing to track something other than clicks and pageviews. Building out the goals config further to something more generic that could config selector, action, bind time (domReady or window.load), and/or the option to delegate the selector so that you don't have to waitForElement poll to bind the handlers would be great.

 

// configurable in goals modal
var selector = $('#config-selector').val(); // '#form' var action = $('#config-action').val(); // 'submit' var ready = $('#config-ready').val(); // true
// psuedocode for binding
$(ready ? document : window)[ready ? 'ready' : 'load'](function () { $(selector)[action](function () { window.optimizely.push(['trackEvent', '{slug}']); }); }) // var delegateTo = $('#config-delegate'); // optional (string) // would be a bit more difficult than coding in the optiverse // code editor before coffee lends itself... I have faith though!

 

Status: Maybe One Day

Optimizely App

Status: Maybe One Day
by jerryaus ‎02-18-2015 February 18, 2015

Optimizely is a great tool that I like more and more every day.

 

However I use my mobile phone a lot for work. I use apps many times of day to get updates about data for our apps and websites.

 

However it's very difficult to access Optimizely on mobile. The website is not adaptive or responsive and for that reason I can only check my results or even work on some experiments on Desktop.

 

It would be great if the users could have an Optimizely app where we could at least check the results.

 

Cheers

Status: Maybe One Day

Add the option for audiences to be joined by an AND instead of the current ANY (OR) for targeting.

 

As default, ANY audience that matches will be included in the experiment.  However, you may want to use multiple audiences to avoid having to create weird hybrids.

 

Example:  A campaign targeted to mobile phones

 

Audience 1:  All mobile devices

Audience 2:  query param = your campaign

 

If you had an "AND", we could use these two audiences (thereby being able to always have a reusable mobile device audience).  However, at present, we would have to create a 3rd audience that has both the mobile targeting AND the query param.  

Status: Great Idea!

Goal descriptions

Status: Great Idea!
by openjck ‎10-10-2014 October 10, 2014

For experiment results to be readable, goal names need to be short. Unfortunately, it can be difficult to describe a goal accurately in just a few words.

 

For example, I am currently setting up a goal that tracks wiki edit submissions, but only on certain pages. The name "Edit submission" is misleading, because not all submissions count. A longer, more descriptive goal name would be better, except that this would make the results page difficult to read—long names cannot be easily skimmed and when a goal name is long, scrollbars appear and part of the name is hidden.

 

An optional goal description would allow an experiment creator to share additional detail without hurting readability.

Status: Great Idea!

Our team would love to have access to BlueKai's data universe, however, being an SME, we're unfortunately priced-out of their Data Activation System.  Allowing Optimizely customers to opt-into BlueKai's segmentation, on a pay-as-you-go model - think MediaMath's Terminal one CPM pricing - would enable us to test & route advanced personalization on an as needed basis... 

Status: Great Idea!

Archive Legacy Goals

Status: Done
by alphanumerritt ‎08-21-2014 August 21, 2014

Need the ability to archive goals that are outdated or that shouldn't be used for one reason or another. Deleting the goals would be great, except that compromises any past test results that utilized the deleted goal. As it is, I've got a bunch of garbage goals in my goal list that just muddy the water when I need to pick/reuse goals for tests. 

Status: Done

Landing page feedback

Status: Already Have It (Partially)
by bryantjaquez ‎04-17-2014 April 17, 2014

Hey everyone. It would be great to see people uploading images of the landing pages they are working for the purpose of getting community feedback. 

Make the report grafics downloadable

Status: New
by Sven ‎06-30-2015 June 30, 2015

Hi,

 

we use screenshots from the results page in our reports and it would save a lot of time if we could just download your realy nice looking grafics.

 

Kr,

Sven

Community Workshop Idea

Status: New
by IanHo ‎04-21-2015 April 21, 2015

I think it would be great if there were more hands-on events. I would love if I could go to San Francisco for a hack-a-thon style optimization event. Less time would be on speakers, more time on collaborating in teams.

 

It could be impleneted many different ways. Here's one way:

 

The competitors at the event could break off into different segments: lead gen, e-commerce, etc. In each segment everyone would be given the same website to "optimize". (The site that's picked could be a random raffle for each segment, every competitor gets to put 1 entry) People then get organized into teams of 3. They then have a set amount of time to setup 3 A/B tests on 3 different pages of the website. Each team presents their tests and pre-selected judges will give out different awards to different teams.

 

Possible awards:

Most Likely to Succeed

Best UX

Best UI

Most Creative Technical Setup

 

At the end, the owner of the website for the experiment can get access to any of the experiments they want to run. As part of entry into the content, you have to agree to run at least 1 experiment and share the results. Once the results are significant, the reults are shared with Optimizely who then shares it with all paricipants.

Status: New

Wordpress blog headline variation testing

Status: Done
by HeatherW ‎04-14-2014 April 14, 2014

I'd love to be able to A/B test different headlines in wordpress easily. Thanks!

Status: Done

I manage multiple separate Optimizely accounts for each of my CRO clients. Whenever I get a notification email (ie. a visitor account overage alert) there's no way for me to tell which Optimizely account the overage is for, based on the content of the email alone. Same thing with billing invoices. I can eventually figure it out if look into the account settings and line up the relevant data (visitor count, invoice date, etc.) but it would be really great if account names were placed into emails and on invoices.

Status: Great Idea!

It would be great to be able to see the conversion rate for multiple goals in the results page, with the ability to create goal "clusters".

 

A lot of our clients have more than one conversion on their site, e.g. sign up, contact us, and chat -- they all become leads.

 

For example:

 

- goal 1

- goal 2

- goal 3

- goal 4

- goal 5

- cluster goal 1 (combination of CR for goals 1-3)

 

This would save a lot of manual Excel work!

Status: Great Idea!

Consolidated Experiment Settings

Status: Done (Partially)
by jeffchin21 ‎10-02-2014 October 2, 2014

While setting up tests and before launching tests, it requires too many clicks to make sure you have all the right settings.  The process can be prone to error, especially when copying experiments from QA to Prod.

 

Currently, audiences and goals are promoted to be out of the 'options' menu - but URL targeting and traffic allocation is important also.  It'd be great to see all of these on one page - as a summary, rather than having to click into at least four settings.

 

 

settings.png

It would be nice if the Global JS/CSS sections of the Optimizely editor were code syntax highlighted and supported code editing functions just like the Variation Code box does!

Status: Done

Wider and easier IP filtering

Status: Great Idea!
by Antti ‎04-18-2014 April 18, 2014

First, I have to say I love the tool and I have found only one issue. I have already sent feedback about this, but since it´s not fixed I’ll give more pressure and write my idea to all. Smiley Happy

 

IP filtering is very frustrating, I mean not so easy and quick thing to do especially when we could have about 50-100 address to filter and 500 character limit is going to be also issue for us. Couldn’t you just make X amount of fields (like in Excel) and to those we could copy & paste our IP-addresses and forget those regular expressions (don’t forget, but as default I don’t want to use those). So like this:

Add IP to filter:
111.222.333.444
222.333.444.555
+ Click this and add new ip to filter.

Or easier and faster way would be just to import .csv file with all the ip addresses and Optimizely could automatically add those to IP filtering. And make it possible to add at least 100-200 IP-addresses to exclude.

Status: Great Idea!

Before the Audiences release, you were able to target based on new vs returning visitors. I know the previous implementation was not ideal, but I would really love to see this general functionality come back in a more robust way. 

Status: Done
Other Ways the Optiverse Can Help
Knowledge Base
Your reference guide for support topics, FAQs, feature documentation, and optimization strategies.
Academy
Learn optimization essentials at your own pace and practice your skills through interactive, step-by-step courses.
Support
View your ticket history or file a support ticket with our team of helpful experts.
​Agencies and Optimizely Partners
Access the Optimizely Agency Portal, an exclusive site for agencies and partners to view Optimizely resources and register client leads.