During experiment analysis, I am getting the 'Sample ratio mismatch' when running a target vs control experiment . Our user base is extremely large and hence we take only a very small %age of users in our global control group ( in absolute terms which still is a few hundred thousands).
Do you think this ratio mismatch would affect the results when using a bayesian engine for analysis?
08/05/2023, 8:32 AM
We warn about SRM errors because they can indicate an implementation bug that may bias the results