I think it would be very helpful if there was a way that we could measure time on page for each Variation. This would allow us to measure engagement in a different way and it would be awesome if it could be measured directly through optimizely.
An example, we have a better more informative product page on our site comparing it against our standard page. If i could set Time on page as a goal and measure it directly through optimizely that would save my needing to dig through GA or another analytics tool.
About once a month or so, someone asks questions about how to move all users into the winning variation.
Currently, when an experiment is over and it is time to declare a winner, to make everyone see the "winning" variaiton, we do the following:
1- clone the experiment
2- in the clone, set the winning variation to 100%
3- pause the original
4- start the clone
5- wait for dev to integrate the winning experience into the site's baseline
6- pause the clone
I propose the creation of a "Declare Winner" option that would effectively accomplish steps 1, 2, 3, and 4.
It would set the winning variation to 100% and would force users bucketed into any other variation into the winner.
(There may be other considerations regarding dashboard indicators, etc.)
I think it would be really great if you can develop a significance calculator where we can input our numbers for example from Omniture and see if the results are significance.
So I can easy see if the order number uplift in Omniture are significance. At the moment I use another online tool (http://www.konversionskraft.de/tools) to get this numbers, but in my point of view I would say it make sense that Optimizely also provide such a tool.
Currently the Revenue per Visitor is just a simple average value. It should be possible to remove outliers in this calculation to get more reliable results.
Currently we have to let run tests longer than they need, just to be sure about the RpV results.
The possibility of removing outliers would be simple feature with big leverage.
Hope you can do this soon!
Was wondering if anyone else has wanted to see the vertical view for tablet? Currently we are only able to see the horizontal view. My main concern was since the site we are working with has finicky responsive states, I wanted to ensure it worked properly in the vertical, narrower view for tablet.
It would be very helpful if it would be possible to share the results link with a custom starting/ending date.
It for example could record every changes made to the GUI in the URL. Therefore it would allow to share links and get people to see exactly what you are looking at.
For now whenever the link is shared, it allows only the standard date(when the experiment has been started).
It can be changed only after the link is loaded.
It looks like this:
It is not too good solution, because if we want to share it with people and our goal is to point out a specific period of time, we would have to tell them to do so manually.
This is an example of what I have in mind:
For example instead of 11th September, it would be 1st October.
For those of us who like dashboards, it would be great to be able to fetch our accounts' monthly users and monitor this along other metrics rather than keep going to the account details page.
It would help us plan or mitigate overusage.
We always use the same analytics and heatmapping integrations for almost every test. Most of our tests use the same goals as well. It would make a lot of sense to have a "default settings" area that we could still adjust if needed.
In the experiments list, it would be nice to have a expansion button to display current percentages for variants of the experiment, and also change them.
Current behavior of:
clicking on experiment -> scroll down to variants -> change percentage -> scroll to bottom -> save
is way too much work.
In addition to the request of amitch5903 I miss also an option to sort variations on coloms like Visitors, Conversions, Conversion Rate, Improvement and Chance to Beat Baseline.
Especially by running MVT tests with a lot of variations you want to sort variations on highest to lowest Conversion Rate, but at least so important is to sort from lowest to highest for example. Another example is to sort on Chance to Beat Baseline to check which variations have the most chance to become winners, or even important losers.
In addition to better sorting the result page it would be great to have an option to exclude traffic for example the worst performing bottom top 10 MVT combinations in an experiment to get faster significant results for the top 10 winners.
It would be very nice if you can reward SWAGS and Some Sort of Appreciation Greeting Card of your company signed by your officials for Bug hunters who reported some Bug in your website
The current Saved Goal implementation can be painful when trying to add several saved goals at once. A simple, but not complete, solution would be to just make the lightboxes larger so less scrolling is necessary. The current implementation results in many cases where there are two vertical scrollbars within the frame, which is frustrating to deal with.
An easier implementation could involve a bulleted list of goals where we can just check off all of goals we want to add at once.
Sometimes in my job I have to use Adobe Target. Optimizely exceeds this tool in every category but there are a couple of features that Adobe offers that would be awesome to see Optimizely roll out (In a better way of course!).
Multi convert goals
Is there a way to allow (as an option) for goals to "always convert" rather than limiting one conversion/per visitor/per goal? We run into cases where it would be beneficial to have Optimizely allow a user to convert 2+ times on the same goal.
A scenario is that we have several forms with varying thank-you pages. We track visits to each individual thank-you page, but we also want to have a goal that is the sum of all these (ex. Visits to - All Thank-You Pages). This way we can have a quicker snapshot of a variation across the board. If a user comes to the site and ends up filling out two of our different forms we want to record a sum total of two, but currently Optimizely would always records this as one.
For example, Adobe Target has a dropdown feature that deafaults to "Count Once" but also allows the tool to force an "Always record conversion".
Another cool feature that I really like is the idea of segmenting goal data based off of another goal. For example, lets pretend there are two goals; the end goal is a "transaction conversion" and there is a micro-conversion, such as "Watched Marketing Video".
The metric I want to see is "Transaction Conversion" of users who converted on goal: "Watched Marketing Video". Then alternatively be able to compare that to a goal that says "Transaction Conversion" of users who did NOT convert on the goal "Watched Marketing Video".
Making it easier to tell if the video is either helping or hurting conversions. By chaining goals together it is helpful to assess the value of an interaction with different elements on a page.
I realize that goals like this can be set up by setting cookies and custom events but it would be sweet if Optimizely was able to create a feature to do it for us (Preferribly by filtering results). Something that would look kind of like this:
So we can sort the Macro Conversion by micro conversions. This would make Optimizely immensely more powerful of a tool using data that Optimizely should already have!
Google Analytics Premium users get up to 200 Custom Dimensions and up to 50 Custom Variables.
Currently optimizely only supports the limits that are built into the standard version of GA (5 Custom Variables and 20 Custom Dimensions).
Would be great to have a checkbox or something that enables the limits available in GA Premium for users that are already using those available in the standard version.