We do quite a lot of MultiVariate tests. The old reports had functionality to allow us to group different multivariate changes together, for example if I am testing 3 variations in the header and 3 variations in the footer, I could group all the results together in such a way that showed me performance for the three variations in the header only. For example, by default you might see:
- Header A, Footer B = X% Conv Rate
- Header B, Footer B = X% Conv Rate
- Header C, Footer B = X% Conv Rate
- Header A, Footer A = X% Conv Rate
- .... and so on, so you'd have 9 rows.
In the old report, I could group it together so I could see the average conversion rate for all variations with Header A, Header B, and Header C so that I could tell my client which of these variations had the most impact, which of the Footer variations had the most impact, and what the winning combination of the two was.