https://www.growthbook.io/
Join Slack
Looking for a growth book expert to fix the issue with the AB test. I don’t see the results of the e...
# ask-questions
g
Looking for a growth book expert to fix the issue with the AB test. I don’t see the results of the experiment. If you know what’s wrong, help me to make a task description for my dev team. Or fix yourself. We can pay by PayPal, of payonner What’s strange I spoke to a product analyst from different company he had the same problem and he had to calculate results manually by BQ SQL
f
That is not common and I'd love to help that other user too...
What is your data source?
g
BQ ga 4
If you have the solution I will pleasure will show to him as well
Is there any update about this?
f
Hi Serhii - you need to check your exposure/assignment query
g
Copy code
SELECT
2  user_pseudo_id as anonymous_id,
3  TIMESTAMP_MICROS(event_timestamp) as timestamp,
4  experiment_id_param.value.string_value AS experiment_id,
5  variation_id_param.value.int_value AS variation_id,
6  geo.country as country,
7  traffic_source.source as source,
8  traffic_source.medium as medium,
9  device.category as device,
10  device.web_info.browser as browser,
11  device.operating_system as os
12FROM
13  `cart2cart`.`analytics_66666666`.`events_*`,
14  UNNEST(event_params) AS experiment_id_param,
15  UNNEST(event_params) AS variation_id_param
16WHERE
17  ((_TABLE_SUFFIX BETWEEN '{{date startDateISO "yyyyMMdd"}}' AND '{{date endDateISO "yyyyMMdd"}}') OR
18   (_TABLE_SUFFIX BETWEEN 'intraday_{{date startDateISO "yyyyMMdd"}}' AND 'intraday_{{date endDateISO "yyyyMMdd"}}'))
19  AND event_name = 'experiment_viewed'  
20  AND experiment_id_param.key = 'experiment_id'
21  AND variation_id_param.key = 'variation_id'
22  AND user_pseudo_id is not null
23
analytics_66666666 - was replaced by fake id (I have real ID in my query in GB)
@fresh-football-47124 I worry about line 22
AND user_pseudo_id is not null
image.png
Do you want to have the Google Meet call? I can invite a person who is good in SQL and data. This is a win-win I will finally start the AB tests and send VWO to hell. You will fix the bug, list it in the documentation, I will leave you the review/video review. I’m at the Kiev time zone. I guess you are at Pacific time zone. I’m ok to do it in night (my time)
@fresh-football-47124
You will have a good, video review. Video on youtube, whatever you want. Also, I will recommend your tool to Product Managers and CEOs of my group of companies. + 3 Active companies will use the tool. But please Help me to fix it.
f
Sorry for the delay
That query looks okay
Are you able to see 'experiment_viewed' events in GA4?
I suspect that the problem is easy to fix - are you using GTM to load GA4?
g
image.png,image.png
f
ya, so the problem is not the SQL query
the events are not making it to GA4
g
Do you think I need to check tag manager to see if I pass that event to GA4
?
f
yes, its most likely tag manager filtering out the events
we have instructions for GTM
g
++
f
g
Ty I will back to you with feed back on Monday
f
okay
let me know
this should be all you need to get it working
g
Dev took a task in my JIRA, I will back with feedback soon
Now I see the experiment’s result. But instead of 49 I see 5 users 😞
r
Hey there! Were you able to figure this out? Or have any updated?
g
@strong-mouse-55694 no. @fresh-football-47124 Please help. I would love to pay to someone to fix this. Do you have support team ?
r
How is your experiment implemented?
g
Hey, Ryan. 1. GA4 + BQ as the data source 2. the experiment is done via visual editor of GB 3. event passed to GA4 via GTM (was recently added)
@strong-mouse-55694
s
What do you see in BQ? Everything looks like it's set up correctly. Do you have the site URL to share?
f
if you're not paying for GA4, then it will only update in BigQuery once a day
is it possible that this discrepancy is just due to not enough time?
g
It’s not the case, I was waiting 2 weeks, the difference is super huge
r
I checked your URL. I see the test and tracking, which both seem to be working. Are you able to check to see the events in GA/BQ?
58 Views
Open in Slack
PreviousNext
Powered by

GrowthBook Users

Open source platform for stress free deployments, measured impact, and smarter decisions.

Powered by