hi all! my company has just started using growthbo...
# announcementsq
quaint-window-98285
05/04/2023, 4:11 PMhi all! my company has just started using growthbook and started with a set of 10 A/A tests. we noticed right away that the group assignment does not seem to be independent across the tests. The tracking keys are very similar -
aatest_1aatest_2quaint-window-98285
05/04/2023, 4:12 PMhere’s a count of users by test group combinations (looking at the first five tests only, across 12 days of testing). 1 indicates experiment group, 0 indicates baseline
f
future-teacher-7046
05/04/2023, 5:36 PM
Hi Chloe. How did you run the A/A tests? Was it using feature flags or inline experiments in the SDK?
q
quaint-window-98285
05/05/2023, 7:42 AMhi Jeremy. we did it using feature flags
quaint-window-98285
05/09/2023, 7:38 AMhey @future-teacher-7046, any ideas on what could be going on here? it seems like there are different hashing functions which would avoid this issue - wondering what it would take to switch
quaint-window-98285
05/09/2023, 1:35 PM@fresh-football-47124 do you have any ideas? sorry to message multiple people, I’m on a bit of a time crunch here 😅
f
future-teacher-7046
05/09/2023, 1:43 PM
Yes, we're in the process of switching feature flags over to the new hashing function. Should be finished this month. I can see if there's a workaround for you in the mean time. Which SDKs are you using?
q
quaint-window-98285
05/09/2023, 2:19 PMgreat to hear! we’re using the Go SDK
quaint-window-98285
05/10/2023, 7:27 AMI think we’ve figured out a workaround for now.
68 Views