Hey GB users, I’m new and like many, switching from Google Optimize with a non-technical background. I’m following the YouTube tutorial and went through the documentation regarding metrics, but still don’t have a clear understanding. In short, can someone tell me the reasons to toggle off any metrics, be them either binomial or count metrics? I’m tempted to leave everything selected. I’m imagining I’ll still be able to select the metrics I care most about to evaluate in an experiment such as purchases/revenue, etc.

Selecting every metric probably won't hurt anything (other than possibly increasing query costs slightly). That said, some caveats to consider... I think generally we'd encourage experimenters to think carefully about what metrics they intend on influencing via a specific experiment (these are "goal metrics") as well as which metrics they want to ensure they are not inadvertently harming or causing an unexpected effect ("guardrail metrics"). If not careful, selecting everything as a goal can lead to "fishing for effect" which isn't always statistically valid. Always perform a sanity check on what the metrics are telling you to reduce this bias. Beyond that, there are some statistical adjustments we perform for advanced use cases that do change depending on which metrics you include in your experiment (p-value adjustments for Frequentist stats, for instance).

Thank you for the thorough response. I’ll make sure we go into experimentation with clear goal metrics to not lose sight of our objectives with CRO.