For the auto-generated metrics chart, we find the past 3 months segmented by day to be limiting. Daily averages are highly variable and I imagine that's the case for many B2B/B2C business metrics based on the day of the week and a smaller sample size.
More useful would be the previous 3 months grouped by week or month, or the previous year grouped by week or month. Even more useful might be two lines -- the above time period from the current year and one from the previous year (if available).
A longer timeline, less aggressive grouping, and more context around those business metrics over time would make the information more stable and therefore useful at a glance for our purposes.
Some options around this would be very nice, different metrics call for different groupings. But I realize that options are problematic to get into. It's a deep rabbit hole. 🙂
08/15/2021, 2:09 PM
I wonder for the use cases of A/B testing if getting some indication of variability/noise might be useful?
08/15/2021, 2:21 PM
What are the use cases you're thinking about?
08/15/2021, 3:57 PM
well, if you're a/b testing the above metric, you'd be aware that on a daily level its super variable - therefore to not draw too much meaning from the values on a daily time scale