MVT Results Page - Measuring the effect of each section?
We are runing an MVT test and I'm looking to isolate the different sections so I can measure the size of the effect of each section? Basically, how can I say:
Section 1 had a XX % effect on the goal
Section 2 had a XX % effect on the goal
Section 3 had a XX % effect on the goal
In my specific case, each of the 3 sections has 2-3 varations. What do I need to select or deselect from the baseline menu on the results page to get the % effect on the goal? Can someone help with details. I see in the below post some general instructions but I need more detail.
Thanks so much!
If I understand correctly, the question relates to how to change the baseline variation of the experiment - is this correct?
If yes, the baseline is indicated in the top right-hand corner of the Results page (but to the left of the right panel). It is indicated by a "Baseline" text. It's also covered within our knowledge base article here: https://help.optimizely.com/hc/en-us/articles/2000
Let me know if I've misunderstood what you're looking for!
Manager, Technical Support
Thanks for the reply. I understand I can choose different sections from that drop down and switch around the baseline. What I don't understand is how to configure it so I tell what impact each section had on the goal.
For example, I have 3 sections in my MVT test and each section has an original/variation.
If I wanted to say
Section 1 had XX.XX% Impact on the Primary Goal
Section 2 had XX.XX% Impact on the Primary Goal
Section 3 had XX.XX% Impact on the Primary Goal
Section 3 - Original had XX.XX% Impact on the Primary Goal
What do I need within that drop-down menu to report the impact of the section? Do I uncheck the boxes for each of the sections except the one I want to see the impact? Well that give me an impact percentage?
I attached a generic screenshot where you can see the Impact is shown on the far left for each of the sections and the specific elements of that section.
Thanks so much!
I am running a 7x2 MVT experiment and want to see the combined lift for each section variation, as the results page you displayed above shows.
My current reporting only shows every single combination of variations, and is basically useless since the traffic isn't aggregrated.
How do I see the reporting by section variation that you show in your screenshot?