billowy-window-9720001/24/2024, 11:00 AM
Hey folks, where can I see the Chance to Win calculation in more detail? Are there differences between Bayesian and frequentist engines? For Bayesian, is it considering loss function and risk?
I was reading this page here, but there is not much explanation in detail for the Chance to Win calculation, and I can't see the expected loss on the new UI aparrently.
Chance to Win
helpful-application-710701/24/2024, 6:19 PM
For Bayesian, is it considering loss function and risk?Expected loss, or risk, is separate from chance to win. They often go hand-in-hand, but not always.
I can't see the expected loss on the new UI aparrently.It can be found in the metric tooltip, and we use tooltips on Chance to Win to alert when it is high.
billowy-window-9720001/25/2024, 10:39 AM
helpful-application-710701/26/2024, 6:42 PM
Does Growthbook has any tool or metric to assist the teams to estimate the sample size needed for the test? Or is there any online calculator for the bayesian version of the experimentation?Frequentist calculators can be useful for getting a rough ballpark estimate, but as I mentioned in the other thread, we plan on building a dedicated growthbook tool in H1 this year.