We have run into the situation where experiment is...
# experimentation
p
We have run into the situation where experiment is disabled on production on growthbook, but new users are still getting assigned to the variant. The experiment has been stopped an hour ago - even the toggle for the feature is off for production. Yet, every minute between 4 and 13 users get assigned to the variant and some of them are first-time users. Any ideas what might be causing that?
s
My first guess would be caching. Where is the experiment running?
f
Hi @strong-mouse-55694 I will take over from my colleague - the experiment is running on our main page. It was running for 2 days, then we stopped the experiment without enabling temporary rollout. Then we noticed that the experiment keeps showing to people, we discussed with our engineers and they suggested turning off the feature flag as well, but traffic keeps coming. We are not talking about a few views, we are talking about more than 40,000 visits so I don't thing this could be cache. 90% or more of these visitors are first time visitors who have made their first visit after the experiment has been stopped and they were still assigned the feature ID.
s
Thanks for following up. That's helpful info. Can you share how you implemented the flag? Are you able to share page where this is happening?