Hi! I wonder what method you use to estimate the r...

# announcementss

some-planet-44104

08/12/2023, 9:39 AMHi! I wonder what method you use to estimate the relative uplift in confidence intervals in Frequentist engine? My understanding is that it’s not possible to do that with parametric method since the distribution of the uplift doesn’t have a defined variance and expected value (Cauchy distribution)?

f

fresh-football-47124

08/14/2023, 2:24 AM

h

helpful-application-7107

08/14/2023, 2:31 PMThere are many common approaches to estimating relative change in frequentist testing. We use the delta-method derived estimate of the variance to build our confidence intervals.

s

some-planet-44104

08/14/2023, 5:28 PMThanks! I should probably familiarize myself with it. Didn’t notice this mentioned in the docs Graham provided, but indeed it’s there.

h

helpful-application-7107

08/14/2023, 7:07 PMIt's not very visible. I'd like to write more detailed statistics docs, but unfortunately we're prioritizing other features at the moment 🙂

26 Views