Hey everyone, We recently implemented a new feature and initially made it available to a select group of Beta testers. We’re now planning to run an A/B test with all our customers. Ideally we can include our beta testers in our experimentation but we have to make sure that they are assigned to the variation still. Is it possible to manipulate the assignment for some users or do we need to exclude them from the experiment? Thanks for your help!

I think you will need to exclude them from the experiment. Because you did not randomize which beta tester got the new feature, adding them all to the

variation

and not splitting them across the

variation

and the

baseline

will result in biased results. If I'm understanding you correctly, you should keep those beta testers being forced to get the variation and experiment on the rest of your users.

Ok, thanks for your fast response!