hey, I have a question about conversion window. Does it work from the very first exposure to the experiment only or does it work from any exposure to the experiment? Let's say that we have 24h conversion window, customer gets exposed to the experiment for the first time, then all conversions that this user does in next 24 hours for that metric are taken into account. Now if the user comes back in a couple of days, there could be two scenarios (1) is not exposed to the experiment; (2) is exposed to the experiment. From the visual attached (
https://docs.growthbook.io/app/metrics#metric-windows), it looks like in both (1) and (2) user's conversions won't be taken into account on the subsequent experiment activation. Is that correct? Or in (1) the conversions won't be taken into account and in (2) they will be taken into account for the next 24hr from this subsequent exposure to the experiment?
I think a better approach would be to have it cover all exposures rather than the very first one only. There are experiments e.g. in my account page, where users might not visit that often, then each exposure should be indicator that user has been potentially affected by the changes, so the the conversion action is relevant. What would be the rationale behind having the window start from the first exposure only?
Also activation metric could be related to that. We often have experiments where user is activated to the experiment only once, at the start of the application, even if the have not experienced the changes that are part of the experiment. In that case activation metric could act similarly to how experiment exposure works. Then the conversion window could be calculated from the the particular instance of activation metric event timestamp.
Please let me know what you think.