This message was deleted.
# announcementsw
worried-planet-2191
10/04/2022, 1:00 AMThis message was deleted.
f
future-teacher-7046
10/04/2022, 1:01 AM
If your experiment does not have an effect on users, the "Chance to Beat Control" will stay around 50% forever, no matter how much data you collect.
future-teacher-7046
10/04/2022, 1:04 AM
If there is a difference, it will tend towards either 0% or 100% as you gather more data. Given you have plenty of users and it's still in the middle means the experiment likely is not affecting your metric.
b
brash-raincoat-88597
10/04/2022, 1:10 AMAhh right, it’s a chance… okay I understand the 100% part, but when would it reach 0%?
f
future-teacher-7046
10/04/2022, 1:10 AM
If it's worse than the control, it will tend towards 0%
b
brash-raincoat-88597
10/04/2022, 1:11 AMGot it, thank you very much
142 Views