Are you exposing all users to the experiment on the front end and then only tracking 10% of them in the data warehouse?
c
cool-vegetable-70424
01/27/2022, 11:29 PM
With our setup we could either do full exposure or exposure to just the tracked cohort. (Right now we're running tests on the full population using Game Analytics, which is extremely limited but free)
f
future-teacher-7046
01/27/2022, 11:31 PM
Ok, I'd probably recommend only exposing the tracked cohort to an experiment. As long as your sampling is truly random, it shouldn't be an issue statistics wise.