08/17/2022, 8:44 AM
Hi again! I was just wondering if you have any tool / experience / advice in terms of minimum amount of data to reach significance in an experiment. I’m aware of the bayesian use of risk of loss for calling the test, but this is something useful once the experiment has already started and there is data being collected. However, in the experiment design phase, there are some timelines (at least to be used as minimum) we need to agree with the rest of the teams. Many thanks again.


08/17/2022, 11:59 AM
The frequentist sample size calculators are usually a good approximation for what you'll need.
We are planning on adding a Bayesian sample size calculator to GrowthBook in the future based on historical data.


08/17/2022, 12:03 PM
That would be really interesting. Thanks a lot for your answers 🙂