Hi, we are working through an issue where we are showing 1300 events for a metric in the "metrics" view but only seeing ~250 events across the control and variant in the results tab of an experiment. We're running the experiment globally. Does anyone have any ideas as to why we might not be seeing all 1300 events tied to the experiment?
04/12/2022, 5:03 PM
The metric page shows a count of all conversions per day. But some of those are excluded from experiment results for a number of reasons. For example, if the conversion didn't happen within the metric conversion window.
For the global experiment, are you seeing the expected number of users in each variation or is that low as well?
04/12/2022, 7:10 PM
Good thoughts Jeremy, looking into this
In GA, we're seeing 21,647 unique visitors with the Experiment Viewed event and 186 unique visitors with the Experiment Viewed event who then converted (GA segment created from sequential conditions).
In GrowthBook, we're seeing 25,082 visitors and 243 conversions
@future-teacher-7046 we considered this could be visitors with an ad blocker, but if that were the case shouldn't we see a consistent variance against conversions as well as visitors?
If my math is right it's a ~14.79% difference in visitors and a ~23% difference in conversions
04/12/2022, 9:50 PM
not sure why you'd be seeing more users in GrowthBook than you do in GA. Are you looking at the same date range? Did you change the SDK implementation at all recently?
04/12/2022, 10:23 PM
Same date range, no recent change to the implementation