Hi there, I was wondering how it is determined whe...
# announcements
f
Hi there, I was wondering how it is determined when something will show up in
chance to beat control
- I was looking through the docs to see if there's some threshold or if it's in our settings but I have not found it
f
On the metric page, if you edit the behavior settings and go to the advanced setting, there's a
Minimum Sample Size
option that defaults to 150 conversions. Until one of the variations reaches that number, it will show "not enough data"
f
ah! got it. Thank you!
can you share more about why 150 is the default? (trying to understand if it's arbitrary or not, and whether we should change it)
f
if the number is too low, it could be caused by random variation in events
you can lower it as you see fit
f
We've found numbers tend to stabilize around 100-200 conversions, so picked 150 as the default
f
thank you!