The downside of waiting for metrics to "mature" is that data is delayed by the conversion window, so it can take a while to see results after starting the experiment. That's why we don't default to that setting.

Hi Jeremy, a follow up question here: I’m seeing that binary metrics don’t have this

"in-progress behaviour"

parameter. This means that, even if the

Conversion Window

is set, for example, to 48 hours, as soon as a new entry/user is assigned to the experiment, it will be counted in the denominator of the metrics, regardless of the maturity of this return didn’t reach the conversion window yet. This is correct? Thanks again.