Hi, hoping you all can help us understand a funny output of the allocation model. Seems the allocation model is assigning similar (but different) ids all to the same side. These ids are different by the last digit but don’t seem to be getting allocated evenly across the two sides. Any idea whats going on here.
02/23/2023, 3:42 PM
Hi Vincent - what are we looking at here? can you share the code you’re using to do the assignment?
02/24/2023, 12:42 AM
@fresh-football-47124 this is the results of experiment assignment from growthbook. We are assigning based on AnonymousId. As you can see from table, we are getting more assignment to variant 1 even though we have asignment set to 50/50. The misbalance seems to be driven by the similiar AnonymousId being grouped together.
Similiar AnonymousIds being grouped together was surprising to us, so was wondering if there was a reason for this happening.