Hi team! We at `groover` have experienced the same issue twice recently, for the projects `hype-roll...
c
Hi team! We at
groover
have experienced the same issue twice recently, for the projects
hype-rollout
and
curator-onboarding
, and are concerned about what’s happening. In both cases, we were in the process of setting up a test/rollout, where in our
dev
and
staging
test envs, users received the treatment experience. However, the prod env was not rolled out in Growthbook (0% treatment / 100% control). We received reports in both cases of users seeing the test/feature live in prod, when it was not yet fully developed, leading to customer frustration. In response, we then set our dev envs to 0%, and the issue disappeared. Could there be cross-environment pollution happening? We’re nervous that this could potentially affect our test results as well. Please advise, thank you! 🙏
f
Are your different environments using different SDKs?
that's what I would check first
c
Nope, they’re the exact same sdks (on vue 3)
e
what about sdk connections?
f
You should have a different SDK endpoint per environment
that way 'dev' features will go only to the dev SDK
c
ah yes, there are different endpoints/env, our issue is that sometimes it “flashes” other test cells that are not the control one
f
ah, client side SDK?
there are a few ways to deal with client side flickering: we have an anti-flicker script (which blanks the page while things are loading), or you can try to make sure growthBook loads faster, or you can use the CDN edge SDK.
c
Thank you! We’ll look into this