https://www.growthbook.io/ logo
Join Slack
Powered by
hi there, I’m seeing a Multiple Exposures Warning ...
# ask-questions
a
hi there, I’m seeing a Multiple Exposures Warning in an experiment that we’re running. We launched our variation (treatment) group at 10% and ran it for a month. Earlier this week, we wanted to ramp up to 20% and so we created a new Phase at 20%. We’ve been seeing this warning since then. We didn’t make any changes to the client implementation at all. Did we misconfigure something in growthbook?
f
you ramped up the over all exposure?
a
no, we changed the variation percentages
f
do you have sticky bucketing enabled?
changing the variation splits may cause users to switch variants,
a
nope 🙂
even if you don’t do phases? I guess I was under the impression that the bucketing was deterministic. Sounds like that’s what sticky bucketing enables
f
yes
it is deterministic in that you get the same number for assignment
so the hashed value is the same
but if the split percentage changes, the users can switch variants
a
ahh gotcha. Is it possible to fix our current experiment or should we start fresh?
f
what is the split now?
a
it’s 20/80
f
we will ignore multiply exposed users
so if you're okay throwing out those results, you can keep it
a
ok thanks
f
we suggest running experiments at an equal percentage, and ramping overall exposure
a
really appreciate the help here. You all have a great product!
f
that way ramping up or down doesn't change the multiple exposure
thanks
17 Views
Open in Slack
PreviousNext
Powered by