quaint-window-9828507/31/2023, 4:07 PM
__denominatorUsers as ( SELECT initial.analytics_id, t0.conversion_start as conversion_start, t0.conversion_end as conversion_end FROM __experiment initial JOIN __denominator0 t0 ON (t0.analytics_id = initial.analytics_id) WHERE t0.timestamp >= initial.conversion_start AND t0.timestamp <= initial.conversion_end ),
helpful-application-710708/01/2023, 6:11 PM
Hence, if the user converted after the appropriate window, but they’d also fired another experiment event later on, they will end up in the data set.So I think the more accurate representation here is: "if the user converted after the first window closed, but they converted within the conversion window of a later exposure, they will end up in the data set." I am curious if you agree with this @quaint-window-98285, and if this explains the discrepancies you're seeing. Why is it this way? This is because our denominators tend to act like activation metrics, where they act as the kind of "first exposure" rather than the experiment event itself. This was probably built that way so that if a user hit an exposure a bunch of times, but then it wasn't until some activation event fired that they are considered "exposed" they would be included. What should we do? I agree that we should support the case, especially for denominators, if not for activation metrics, where you want to just look at denominators in that first exposure window. We have a TODO to improve some of our ratio metric functionality and I'll add this to that list. I also agree that this is more of a "bug" than our other planned improvements so I'll treat it with higher priority.
quaint-window-9828508/02/2023, 1:31 PM