https://www.growthbook.io/ logo
Join Slack
Powered by
Hey folks - I'm seeking clarification on 2 items p...
# ask-questions
c
Hey folks - I'm seeking clarification on 2 items pertaining to GrowthBook: 1. Does GrowthBook adjust a user over time if they convert on a second visit, or are metrics captured based on their first session only? 2. We have an experiment where GrowthBook is reporting only 20% of the total traffic and conversions when comparing against data for this experiment in GA4 - does GrowthBook only capture 20% of the experiment values?
Regarding my second question noted above. Here is a screenshot of the GrowthBook experiment traffic (which is set to 50/50 for one variant while the actual traffic allocation was to 100% (we did not throttle it) The same time frame in GA4 showing a whopping 89% more users to the page where we conducted an experiment that was supposed to be split 50/50 (control vs variant) - see the second screenshot below. I'm unable to determine why GrowthBook has only captured 9% of the user volume to this experiment
@fresh-football-47124 can either yourself or a team member look into this please?
s
Hey there! 1. GrowthBook counts any conversion that happens within the conversion window, so, yes, second visits would be counted. Exceptions can apply depending on your metric types/options. 2. GrowthBook doesn't limit traffic, so there's something going on with the data. First, I'd confirm that the timeframes are equal. Next, I'd look at BQ and ensure that the data there looks right. Also, have you set any kind of metric conversion window in your metrics? Finally, how is your experiment set up?
🙌 1
c
Hey @strong-mouse-55694, all of this is great, thank you. I'm going evaluate BQ some more per your reco
s
If you continue to run into discrepancies, please make another post! Good luck
c
Thanks very much, appreciate your assistance
25 Views
Open in Slack
PreviousNext
Powered by