Open source feature flagging and experimentation platform for stress free deployments, measured impact, and smarter decisions.

GrowthBook Users

Hi Yaniv. We don't automatically correct for outliers, but we do have the ability for you to adjust for this. You can add a capped value to adjust for this: <https://docs.growthbook.io/app/metrics#capped-value>

you can also do any custom filtering if you're using a SQL data source from the experiment configuration

got it, thanks!
ideally I would prefer to have something that removes values based on percentiles, rather than caps.
we can achieve that in the metric queries as well <@U01T6HCHD0A>

this is a tricky topic, this can cause experiments to flip based on these values (percentiles or caps), as a user of GrowthBook, this is part of the magic i'd love to get from the product :slightly_smiling_face:

thanks for the feedback. It's really tricky to make something work for all cases. I'll bring it up with the team

absolutely, though if it's not supported, this is something relatively hard to figure out for small orgs with limited proficiency in statistics :slightly_smiling_face: