This message was deleted.
# experimentation
w
This message was deleted.
m
As we can see - results of variants are not identical. But as for me - it should be. Any investigations, ideals of how to understand better "why" results are not identical? Maybe someone is also runned A/A with growthbook and could share results?
p
I would say that the sample size is not big enough. Give the test some more time, and it should become closer to 0% change for all metrics. Currently these results could easily happen by chance 🙂 So I see no issues, as you should get a bigger sample size before analyzing the A/A test
🔥 2