Hello everyone, I'm using growthbook with mixpanel...
# announcementsw
white-salesclerk-40048
01/15/2023, 1:23 PMHello everyone, I'm using growthbook with mixpanel and noticed that the total users in the results section of an experiment is much less than the experiment started event in mixpanel, what could be the reason for that or what could I take a look at to know where the problem is? Thank you in advance.
f
fresh-football-47124
01/15/2023, 1:24 PM
This can often be because of the date range
w
white-salesclerk-40048
01/15/2023, 1:25 PMI'm filtering for the duration the experiment has been running in on mixpanel and the experiment is still running
f
fresh-football-47124
01/15/2023, 1:27 PM
We give the full query used, you can check and run it yourself to see what’s going on
w
white-salesclerk-40048
01/15/2023, 1:53 PMThe date range is also correct in the full query
white-salesclerk-40048
01/15/2023, 1:57 PMSometimes the fetch features API calls fail but the total failures are much less than the difference between number of events on mixpanel and the users in the experiment on growthbook
f
fresh-football-47124
01/15/2023, 3:09 PM
I wonder if mixpanel is showing all event instead of unique users?
w
white-salesclerk-40048
01/15/2023, 3:51 PMI think it does actually but the total of users in the 2nd screenshot from growthbook has been the same for a while (227) while mixpanel's number gets updated correctly
f
fresh-football-47124
01/15/2023, 3:51 PM
Did you click update?
w
white-salesclerk-40048
01/15/2023, 3:52 PMI reviewed the distinct ids too and they're mostly unique
white-salesclerk-40048
01/15/2023, 3:52 PMyess
white-salesclerk-40048
01/15/2023, 3:54 PMtotal users increased after the last update it's not constant, but still much less than mixpanel's events it only increased by 3 users
white-salesclerk-40048
01/16/2023, 5:19 PMAfter a lot of testing I noticed that the total number of users in the experiment on the growthbook dashboard is the number of users testing on our deployed versions on staging (we're using next.js and testing on the deployed versions on vercel) keep in mind I'm using the correct API keys for staging and production, the experiment started event logs correctly on mixpanel too but only the users on staging environments are getting counted in the experiments
f
fresh-football-47124
01/16/2023, 5:21 PM
What is different about the staging environment and your production env? Are they the same?
fresh-football-47124
01/16/2023, 5:22 PM
Perhaps there is something misconfigured with the mixpanel data source on GrowthBook
74 Views