Hi team, is there a way to run experiments on different level? Can leverage GrowthBook so that it runs user level experiments as well as page level experiments? I haven't found relevant materials from the documentation cc: @gorgeous-needle-6147

yes, I believe so…

I think Growthbook is defaults all of the experiment analysis at the user level

we’ve used Ratio Metrics to get at this, but it does require creating 2x as many metrics to be able to get things at a device/event level

you can add a ‘pageurl’ as an attribute, and then target experiments at that

This is a complex area with a variety of solutions. One possible solution is to just focus on your unit of interest: pages. In general, GrowthBook doesn't care what unit you are working with. You could work with pages, devices, users, etc. all the same, so long as you are firing experiment impressions and bucketing on that ID AND have metrics set up that are at that ID level. For example, you could randomize pages by some page ID, and then analyze user behavior on that page that gets tracked at the page ID level. This will require you to create a page ID, fire a tracking callback whenever you randomize the page into one treatment or another, get features using that page ID, and then connecting GrowthBook to your data warehouse with a

page

ID type. You then would need to create metrics that were at this

page

level, whether it was aggregating over user behavior on that page or some other metric, but basically you need to create a metric on that same

page

ID level. There are some statistical nuances I could get in to here, but if you wanted to randomize at the page level (e.g. load version X or Y for all pages that get loaded), then this is one possible approach.

@helpful-application-7107 it isn’t exactly the same in that for us it isn’t a

page

that we are evaluating. Also growthbook is our analysis tool, but is not serving features so I don’t know how much that would alter what someone else could implement easily. I don’t have the time today, but will try to summarize the setup for you and some of the tradeoffs we are willing to accept.