Hello! We’re trying to run an A/A test, and are ge...
# experimentation
i
Hello! We’re trying to run an A/A test, and are getting stuck somewhere in the very beginning. We have set up a boolean feature flag that works as is, but as soon as we tie it to an experiment (A/A test where both groups are served the feature) the feature flag becomes
null
and the
trackingCallback
never fires, even though we would expect more or less all users to be exposed to the experiment. Attached is first a screenshot of the DevTools extension of the feature flag before an experiment is tied to it, then a screenshot of how it looks after linking it to a running experiment. Details: SDK: React,
1.4.0
Hash attribute is set when instantiating GrowthBook (user’s id) - tried both with authenticated and non-authenticated users GrowthBook initialization and experiment are both running client-side in Next.js There are no activation metrics or segments filtering out users Feature is enabled in all environments The experiment assignment queries seem to be correctly set up based on what we have in our datasource (Matomo). They are currently not returning any rows, but I assume that is because we have had 0 experiments run so far.
This is the other screenshot, of the DevTools after experiment has been started:
s
Hi Tilda, can you please double check that your targeting conditions and your tracking key are correct? Can you please check that your
user id
is being set?
i
Hi Luke, We don't have any specific targeting set by attributes/saved groups and are including 100% of our traffic. We're setting the user
id
attribute when initializing GB. About verifying that the tracking key is correct - I know the value of the tracking key and as far as we can tell there are no events with that key in our data source, if that is what you meant?
s
Hi Tilda, let me please check with our engineering oncall, and I will get back to you.
🙏 1
i
Thank you!
s
Hi Tilda, could you please send the
id
of your feature? Thank you.
i
Hi Luke, we just managed to solve this by refactoring our entire Growthbook setup, there were a few quirks hiding in there that must have made it work in a weird way. Thanks for your help!
s
Hi Tilda, I'm glad that it worked out. Please let me know if you need anything else.
🙏 1