We have multiple ids that our product experiments are randomized by, e.g. browser cookie, user_id, page_id. The analysis metrics we set up in growthbook only make sense when they match the id that was used for randomizing experiment participants, e.g. we'd use a browser-cookie retention metric for a browser cookie randomized experiment, and a user_id retention metric for an experiment randomized by user_id. What's the best way to make sure that we use the right metrics for analyzing each experiment? Should we come up with a clear naming convention, or is there some sort of programmatic way we can prevent data scientists and product managers from accidentally adding the wrong metric to an experiment? thank you! cc @polite-pillow-33171 @worried-lizard-90583 @adventurous-diamond-953

Hi Chris - each metric is assigned to the randomization unit, but I'm not sure if there is a way currently to prevent them from being used. Let me check with the team on a solution here.

thank you!

Hi Chris. > What's the best way to make sure that we use the right metrics for analyzing each experiment? • Ensure in your Data Source you have an

Identifier Type

and matching

Experiment Assignment Query

in for any id you randomize by. • Ensure your Metrics match to their corresponding

Identifier Type

. Metrics can have more than one

Identifier Type

if your data has multiple ID columns (e.g. you have both cookie_id and user_id in one column). • Make sure your analysts pick the right

Experiment Assignment Query

when analyzing their experiment. This makes sure we look for the right assignment events in your data source to see which `id`s are in the experiment. Ideally, we could tighten the connection between

Hash Attribute

ids and

Identifier Type

, but once you pick the right identifier type by picking the right Experiment Assignment Query/Table, the metrics will follow suite.

thank you! that's helpful to know, and yes that feature would be great to have in the future

we created an issue for this, if you want to follow along: https://github.com/growthbook/growthbook/issues/2020

will do, thanks!