Hi guys - we are about two weeks away from going live with a new navigation test, which is exciting, but the way we have approached it as a business has been from a 'we want to make it look prettier'.
I'd love to hear from the community here how you would measure the success of a navigation change like this?
Would love your thoughts and/or suggestions.
The way I am looking to do it is as follows:
With the end goal being bets placed using number of bets placed conversion - thinking being if the new nav makes it easier to find the page/market a users is after, conversion will go up.
Will will also be looking in Google Analytics for time spent on page, page value, exit rate etc.
Obviously many of our repeat users are “trained” to use the old nav and a change could throw them. To counter this we will use a segment for “New Users”, so we can look at them in isolation, I think they’re a better measure of this UX change. One problem we are going to encounter is the login/logged out state so we may just target Chrome browser instead.
Thanks for reaching out to Optiverse!
To answer your question, if the end goal of the navigation change is to increase the number of bets being placed, then this should be the metric you would track to determine if the experiment is successful or not. Out of the two variations (original nav and new nav), which one generates the most bets? This is something you should be able to have a clear view on, with the right Custom Event Goals set in Optimizely.
It's very exciting to start testing! Let us know how your test does!