Would it be possible to trigger a dynamic notification (lets go with email for simplicity sakes) for experiments that:
- Have hit statistical significance for specified set of goals (so 1 or more)
- Have hit a consistent statistical significance over a user specified duration
In both instances the test designer would dictate the duration and the specific goals of interest.
Imagine running 20+ tests across multiple accounts and having to check them periodically to understand whether the experiments have completed based upon multiple goals, some primary, some secondary. Like you would in a marketing agency, for example.
Perhaps another approach would be to allow users to set a scheduled/periodic email containing a CSV or Excel report for a specific experiment. That might save users time on exports and, dare I say, an easy (consistent) interim solution for those of us who like to scrape the results data out of our experiments and push it into "fancy" dashboards.
Just sayin' - Thoughts?