I manage multiple separate Optimizely accounts for each of my CRO clients. Whenever I get a notification email (ie. a visitor account overage alert) there's no way for me to tell which Optimizely account the overage is for, based on the content of the email alone. Same thing with billing invoices. I can eventually figure it out if look into the account settings and line up the relevant data (visitor count, invoice date, etc.) but it would be really great if account names were placed into emails and on invoices.
While setting up tests and before launching tests, it requires too many clicks to make sure you have all the right settings. The process can be prone to error, especially when copying experiments from QA to Prod.
Currently, audiences and goals are promoted to be out of the 'options' menu - but URL targeting and traffic allocation is important also. It'd be great to see all of these on one page - as a summary, rather than having to click into at least four settings.
Before the Audiences release, you were able to target based on new vs returning visitors. I know the previous implementation was not ideal, but I would really love to see this general functionality come back in a more robust way.
The current Saved Goal implementation can be painful when trying to add several saved goals at once. A simple, but not complete, solution would be to just make the lightboxes larger so less scrolling is necessary. The current implementation results in many cases where there are two vertical scrollbars within the frame, which is frustrating to deal with.
An easier implementation could involve a bulleted list of goals where we can just check off all of goals we want to add at once.
In Optimizely Classic, it was very easy to click to see total vs unique data on each metric in the results page. Now with Optimizely X, you either have to create two metrics (one unique and one total), or go back in and edit a metric to change it to total in order to see the total data. This is time-consuming and frustrating vs. the easy way this was done in Classic. Our experiments are unlike the 'standard' ones which only have a few metrics. We have many that are based on increasing engagement on the page, and as such we need to measure how many different things are affected or changing. We have lots of metrics we are tracking. And for many of these, if they are click-based, we need to see the totals. It takes a lot of time now to go in and pull this data.
Sometimes in my job I have to use Adobe Target. Optimizely exceeds this tool in every category but there are a couple of features that Adobe offers that would be awesome to see Optimizely roll out (In a better way of course!).
Multi convert goals
Is there a way to allow (as an option) for goals to "always convert" rather than limiting one conversion/per visitor/per goal? We run into cases where it would be beneficial to have Optimizely allow a user to convert 2+ times on the same goal.
A scenario is that we have several forms with varying thank-you pages. We track visits to each individual thank-you page, but we also want to have a goal that is the sum of all these (ex. Visits to - All Thank-You Pages). This way we can have a quicker snapshot of a variation across the board. If a user comes to the site and ends up filling out two of our different forms we want to record a sum total of two, but currently Optimizely would always records this as one.
For example, Adobe Target has a dropdown feature that deafaults to "Count Once" but also allows the tool to force an "Always record conversion".
Another cool feature that I really like is the idea of segmenting goal data based off of another goal. For example, lets pretend there are two goals; the end goal is a "transaction conversion" and there is a micro-conversion, such as "Watched Marketing Video".
The metric I want to see is "Transaction Conversion" of users who converted on goal: "Watched Marketing Video". Then alternatively be able to compare that to a goal that says "Transaction Conversion" of users who did NOT convert on the goal "Watched Marketing Video".
Making it easier to tell if the video is either helping or hurting conversions. By chaining goals together it is helpful to assess the value of an interaction with different elements on a page.
I realize that goals like this can be set up by setting cookies and custom events but it would be sweet if Optimizely was able to create a feature to do it for us (Preferribly by filtering results). Something that would look kind of like this:
So we can sort the Macro Conversion by micro conversions. This would make Optimizely immensely more powerful of a tool using data that Optimizely should already have!
Currently the Revenue per Visitor is just a simple average value. It should be possible to remove outliers in this calculation to get more reliable results.
Currently we have to let run tests longer than they need, just to be sure about the RpV results.
The possibility of removing outliers would be simple feature with big leverage.
Hope you can do this soon!
It would be great to be able to see the conversion rate for multiple goals in the results page, with the ability to create goal "clusters".
A lot of our clients have more than one conversion on their site, e.g. sign up, contact us, and chat -- they all become leads.
- goal 1
- goal 2
- goal 3
- goal 4
- goal 5
- cluster goal 1 (combination of CR for goals 1-3)
This would save a lot of manual Excel work!
It would be nice if the Global JS/CSS sections of the Optimizely editor were code syntax highlighted and supported code editing functions just like the Variation Code box does!
First, I have to say I love the tool and I have found only one issue. I have already sent feedback about this, but since it´s not fixed I’ll give more pressure and write my idea to all.
IP filtering is very frustrating, I mean not so easy and quick thing to do especially when we could have about 50-100 address to filter and 500 character limit is going to be also issue for us. Couldn’t you just make X amount of fields (like in Excel) and to those we could copy & paste our IP-addresses and forget those regular expressions (don’t forget, but as default I don’t want to use those). So like this:
Add IP to filter:
+ Click this and add new ip to filter.
Or easier and faster way would be just to import .csv file with all the ip addresses and Optimizely could automatically add those to IP filtering. And make it possible to add at least 100-200 IP-addresses to exclude.
It would be very helpful if it would be possible to share the results link with a custom starting/ending date.
It for example could record every changes made to the GUI in the URL. Therefore it would allow to share links and get people to see exactly what you are looking at.
For now whenever the link is shared, it allows only the standard date(when the experiment has been started).
It can be changed only after the link is loaded.
It looks like this:
It is not too good solution, because if we want to share it with people and our goal is to point out a specific period of time, we would have to tell them to do so manually.
This is an example of what I have in mind:
For example instead of 11th September, it would be 1st October.
For those of us who like dashboards, it would be great to be able to fetch our accounts' monthly users and monitor this along other metrics rather than keep going to the account details page.
It would help us plan or mitigate overusage.