Hello! Does anyone know what might be causing the ...
# ask-questions
s
Hello! Does anyone know what might be causing the discrepancy between the Mixpanel funnel report and GrowthBook (using Mixpanel as the source)? • The timeframe is the same (EST timezone). • The conversion window is the same (72 hours). • Events and metrics have no filters. However, there’s a difference: • Conversions: 5785 (GrowthBook) vs 7154 (Mixpanel) • Traffic: 98.5K (GrowthBook) vs 102.1K (Mixpanel) I suspect it could be due to GrowthBook using the Mixpanel API with the event
distinct_id
, whereas it should be using the people property
distinct_id
to link events before and after registration. Could you confirm or reject this hypothesis? I’m also open to other ideas. Thanks!
l
Seeing the same thing, and also have the same hypothesis RE how Mixpanel links pre-signup and post-signup events. Would love to hear some input on this one from the team as it's causing us some major issues.
1
s
According to the Mixpanel website, the JQL used by GrowthBook is no longer supported. https://docs.mixpanel.com/docs/reports/apps/jql Are there any plans to migrate to the Mixpanel Funnel API recommended by Mixpanel support?
r
Hi, yes the integration is based on the event­_property $distinct­_id, as event data is immutable and not all users will have a $distinct­_id user property (only identified users have user properties $set on their profile). For this, you can leverage the additional event property feature to facilitate the mapping. However, it might be better long term to just use one idenfitier For context, the integration is built on the JQL API as it allows the integration to query the raw data, this API is placed in maintenance mode, meaning Mixpanel will no longer invest in it, but it is still active. When you run the query in JQL what values are you seeing? Asking because the funnels report queries the formatted data, where JQL queries the raw data and the integration is built on JQL so this will be the best source of truth. What values are you seeing when you run the query in JQL?
s
> For this, you can leverage the additional event propertyfeature to facilitate the mapping. However, it might be better long term to just use one idenfitier If I understand the documentation correctly, it gives an extra granularity as there are two fields in group by expression > What values are you seeing when you run the query in JQL? a lower number comparing to Mixpanel Funnel Report
The result of the discussing the issue with Mixpanel Support was a recommendation to switch to Funnel API because they guarantee the quality of this data, but not JQL
r
Does the value you see in JQL match the values you are seeing in GrowthBook, or is there a large discrepancy?
At this time from what I can see changing to the Funnels API is not on the immediate roadmap. However, you may wish to log a product gap for this here so this is on the Engineering teams radar and other customers can also upvote this.
Correct, your understanding on the additional property is spot on. It adds another layer for the mapping.