Hey! How is the blue marked percentages for unique...
# ask-questionso
orange-dentist-2922
07/09/2025, 2:14 PMHey! How is the blue marked percentages for unique users with contact form submit calculated? FYI: users with contact form submit is a metric for how many unique users that trigged the event contact_form_submit
h
helpful-application-7107
07/09/2025, 7:23 PMHi Maximus! The technical details are here: https://docs.growthbook.io/statistics/power#growthbook-implementation
The short answer, is that we take the mean and uncertainty in your metric (e.g. the usual conversion rate for a 0/1 metric, or the mean for a continuous metric like revenue), and your estimated sample size, and then use the formulae above to estimate how often you can observe your stipulated effect size with that big of a sample.
helpful-application-7107
07/09/2025, 7:24 PMSo this is saying that if you have a 100% effect (this is really large by the way!) after 3 weeks when you have 360 users, you only will be able to detect that 100% effect with a statistically significant lift about 8% of the time.
o
orange-dentist-2922
07/10/2025, 9:01 AMahh, alright! Yeah its a bit of a crazy experiment, just for the trial but I get it, thank you so much!🙏
5 Views