https://www.growthbook.io/ logo
Powered by
#ask-questions
Title
# ask-questions
c

clever-hair-5481

10/05/2023, 2:01 PM
Hi! I have a test running that is suddenly showing one cell (
mastering
) to 100% of users instead of the split indicated in GB. Could I help some help to debug please?
f

fresh-football-47124

10/05/2023, 4:24 PM
where do you see 100%?
c

clever-hair-5481

10/05/2023, 4:26 PM
just from QA — every user on the site is seeing the 
mastering
experience
f

fresh-football-47124

10/05/2023, 4:28 PM
how are they QA’ing it?
are they changing the user id for each run?
c

clever-hair-5481

10/05/2023, 5:03 PM
It’s been a problem for a week, each cell links out to a revenue-generating opportunity so we noticed in when we stopped getting revenue from these cells. Then when we tried logging in as different users (different user ids, on multiple computers), we realized we were seeing the same cell
f

fresh-football-47124

10/05/2023, 5:04 PM
How are you setting the id?
c

clever-hair-5481

10/05/2023, 5:25 PM
sorry what do you mean by that? btw the test has been running for >6 months and nothing has really changed about the setup
f

fresh-football-47124

10/05/2023, 6:29 PM
so the way the SDK works, it assigns users based on the ID attribute
if there is some caching or something that causes that ID to not change, it can result in one variation getting all the traffic
we added a section below the override rules, where you can test changing the IDs to see what variation they would get
c

clever-hair-5481

10/05/2023, 7:18 PM
hmm I don’t see it? Is there any chance you have 15 mins to jump on a call about this?
f

fresh-football-47124

10/05/2023, 7:18 PM
oh, are you self hosting?
is the AB test live somewhere I can see?
c

clever-hair-5481

10/05/2023, 8:19 PM
Yes we’re self-hosting. You’d only be able to see it if you signed up for an account on our platform (groover.co … it’s free to sign up, but if that’s annoying I can send a video) => it’s on the homepage of the site The arrow points to the card that changes depending on the test cell: https://jam.dev/c/00c85f76-5a07-4db6-ba0f-617582f4e46b
f

fresh-football-47124

10/05/2023, 9:00 PM
Can you share the code you’re using around the SDK?
let me know if you want to chat
2 Views
Powered by