We are running into issues where GB isn’t running as expected in our testing environments. Is there anything that would prevent tests from correctly showing up in things like cypress?

Hi all, we did not have an SRM warning show up on our experiment dashboard when there was a detectable mismatch in our data:

VARIATION_ID	USERS
    cell1	        439,863
    cell2	        442,411
    cell3	        442,951
    cell5	        442,880

Any idea why the SRM wasn’t caught?

Is growthbook supported on older browser versions? I have implemented A/B tests using react sdk but it keeps throwing error

globalThis is not defined

on older browsers (eg. Chrome 67) @fresh-football-47124

Any idea on when the next version will release?

Hello everyone! Has anyone tried updating mongoose 5.13.15 (or superior) in a selfhost env? The used mongoose version (5.13.14) is with a critical security status (https://nvd.nist.gov/vuln/detail/CVE-2022-2564)

Hello! Has anyone integrated Braze with Growthbook?

Hi, experiment_viewed(exp_id) was not correct. so I added Namespace to avoid conflict. Range was 0-0.5 for one feature and 0.5 to 1 to another. Still I get the incorrect experiment_id which was not even enabled??

Hi team, Could someone from GrowthBook team please provide information on what implications can we imply from

Chance to Beat Control

when running experiments? Would be great if you can also help elaborate on what this parameter means. I am running an experiment and yesterday I was seeing a lot higher value of

Chance to Beat Control

whereas today, when more users are flowing in, this

Chance to Beat Control

went down to 50% though the percent change of the two variants is greater than yesterday (51.4% vs 46.3%).

Hey. I’ve setup a A/B experiment with target condition lets say x=0. On visiting the site, user enters the experiment & gets the variation A. But after getting the variation, x changes to 1. How can i get the same assigned experiment value in future as

useFeature

starts returning the default value as the condition x=0 isn’t met now?

how does growthbook compute over different datasources?

we are not able to send invite emails from growthbook , any leads on this.

we are using this config in docker-compose.yml

Do I need to create a feature in order to run an A/A test or can I just start an experiment with 2 control groups without any feature?

Hi there, good monday! How are you? I'm experiencing an issue with my dev environment, using growthbook feature flags. In my local environment, everything works as expected: growthbook loads correctly, feature flags are read as expected and its values changed whenever I change them on the dashboard. The problem is when I use my dev environment: growthbook loads correctly (this means that the connections is successful), but feature flag values are always

null

. I've already tested changing the connection SDK, but it happens the same. How can I proceed in this case? Let me know if I can give further details. To give further information, I'm running the back-end on GCP, and I can't establish new SDK connections from there, but I can do them from my local environment. I'm receiving this in

req.growthbook

object:

_trackedFeatures: { 'blinded-users': 'null' },

Hiya, what’s the status of Visual Editor 2.0? Is it ready for use yet?

Hi all, it’s very exciting to see the new Slack Integration feature! Just want to confirm that the Slack notifications we can currently get are limited to the Webhook’s Supported Event Types? Meaning

feature.created

,

featured.updated

and

feature.deleted

?

Just wanted to say: 🎊 🍾 Congrats on V2! It’s a huge leap forward both in terms of accessibility/approachability of a full Experimentation Platform while adding many more features that make it a world-class experimentation platform. I’m over the moon for CUPED; I’ve never had access to it before. Thank you for putting the state-of-the-art within reach.

Hey team, I’m running into a scenario where

trackingCallback

is called on every page load, therefore firing our tracking event for every user on every page regardless if they’re entering an experiment. We are using nextjs 13. We have devised a plan to set their status in localstorage, but I thought that

trackingCallback

was only supposed to be called when a user was being placed in an experiment. Is there anything that I’m missing here?

Hello team , we are a double sided marketplace where we have different types of users ( customers and workers ) , currently the user id is set for all the users incrementally in the same table , so a specific user id might be a customer or a worker , however we want to only run an experiment to customers, would this affect the splitting in any way while using this user id as the main attribute ? Thanks

Hello Team, I have a query in json based splitup of growthbook. I want to know, how to split the traffic based on json. Can you give some sample code for javascript?

Hi Team, I have one doubt. Suppose we have a feature and made A/B testing as 50% and 50% users for all 80% users out of 100% users. And now what will be the remaining 20% users able to see the feature or not?

Hello Team , a quick question regarding growthbook python SDK , should i assume the tracking callback if called on the same thread as when i check if feature is on , in other words in case of running an a/b experiment , should i assume that after calling

isOn

function , the tracking callback function should be already executed ?

Hello team , i just set the exposed traffic to 0% of users and i'm still getting users assigned to experiment variants , i'm using growthbook python SDK , is there a reason of why this might happen ?

Hi Team, is there any observability for growthbook monitoring? On my production cluster, the issue is sometime using high cpu and memory that reach the limits and the pods is restarted.. the error logs is below.. but i don’t know which experiment that using high resource

| <--- Last few GCs --->
 | 
 | [58:0x5da0dc0] 425192587 ms: Mark-sweep (reduce) 504.1 (516.3) -> 503.3 (515.8) MB, 5980.9 / 0.1 ms  (average mu = 0.124, current mu = 0.032) allocation failure scavenge might not succeed
 | [58:0x5da0dc0] 425192607 ms: Scavenge (reduce) 504.4 (512.8) -> 504.0 (513.8) MB, 2.9 / 0.0 ms  (average mu = 0.124, current mu = 0.032) allocation failure 
 | [58:0x5da0dc0] 425192786 ms: Scavenge (reduce) 504.5 (512.8) -> 504.2 (514.3) MB, 92.1 / 0.0 ms  (average mu = 0.124, current mu = 0.032) allocation failure 
 | 
 | 
 | <--- JS stacktrace --->
 | 
 | FATAL ERROR: Ineffective mark-compacts near heap limit Allocation failed - JavaScript heap out of memory
 |  1: 0xa3ac10 node::Abort() [/usr/bin/node]
 |  2: 0x970199 node::FatalError(char const*, char const*) [/usr/bin/node]
 |  3: 0xbba58e v8::Utils::ReportOOMFailure(v8::internal::Isolate*, char const*, bool) [/usr/bin/node]
 |  4: 0xbba907 v8::internal::V8::FatalProcessOutOfMemory(v8::internal::Isolate*, char const*, bool) [/usr/bin/node]
 |  5: 0xd76b25  [/usr/bin/node]
 |  6: 0xd776af  [/usr/bin/node]
 |  7: 0xd854eb v8::internal::Heap::CollectGarbage(v8::internal::AllocationSpace, v8::internal::GarbageCollectionReason, v8::GCCallbackFlags) [/usr/bin/node]
 |  8: 0xd890ac v8::internal::Heap::AllocateRawWithRetryOrFailSlowPath(int, v8::internal::AllocationType, v8::internal::AllocationOrigin, v8::internal::AllocationAlignment) [/usr/bin/node]
 |  9: 0xd4e87d v8::internal::Factory::AllocateRaw(int, v8::internal::AllocationType, v8::internal::AllocationAlignment) [/usr/bin/node]
 | 10: 0xd48704 v8::internal::FactoryBase<v8::internal::Factory>::AllocateRawWithImmortalMap(int, v8::internal::AllocationType, v8::internal::Map, v8::internal::AllocationAlignment) [/usr/bin/node]
 | 11: 0xd499b2 v8::internal::FactoryBase<v8::internal::Factory>::NewDescriptorArray(int, int, v8::internal::AllocationType) [/usr/bin/node]
 | 12: 0xf6d687 v8::internal::DescriptorArray::CopyUpTo(v8::internal::Isolate*, v8::internal::Handle<v8::internal::DescriptorArray>, int, int) [/usr/bin/node]
 | 13: 0xf5f63f v8::internal::Map::CopyAddDescriptor(v8::internal::Isolate*, v8::internal::Handle<v8::internal::Map>, v8::internal::Descriptor*, v8::internal::TransitionFlag) [/usr/bin/node]
 | 14: 0xf5f8a8 v8::internal::Map::CopyWithField(v8::internal::Isolate*, v8::internal::Handle<v8::internal::Map>, v8::internal::Handle<v8::internal::Name>, v8::internal::Handle<v8::internal::FieldType>, v8::internal::PropertyAttributes, v8::internal::PropertyConstness, v8::internal::Representation, v8::internal::TransitionFlag) [/usr/bin/node]
 | 15: 0xf617a0 v8::internal::Map::TransitionToDataProperty(v8::internal::Isolate*, v8::internal::Handle<v8::internal::Map>, v8::internal::Handle<v8::internal::Name>, v8::internal::Handle<v8::internal::Object>, v8::internal::PropertyAttributes, v8::internal::PropertyConstness, v8::internal::StoreOrigin) [/usr/bin/node]
 | 16: 0xf51e9f v8::internal::LookupIterator::PrepareTransitionToDataProperty(v8::internal::Handle<v8::internal::JSReceiver>, v8::internal::Handle<v8::internal::Object>, v8::internal::PropertyAttributes, v8::internal::StoreOrigin) [/usr/bin/node]
 | 17: 0xe1444b v8::internal::StoreIC::LookupForWrite(v8::internal::LookupIterator*, v8::internal::Handle<v8::internal::Object>, v8::internal::StoreOrigin) [/usr/bin/node]
 | 18: 0xe183a7 v8::internal::StoreIC::UpdateCaches(v8::internal::LookupIterator*, v8::internal::Handle<v8::internal::Object>, v8::internal::StoreOrigin) [/usr/bin/node]
 | 19: 0xe18a74 v8::internal::StoreIC::Store(v8::internal::Handle<v8::internal::Object>, v8::internal::Handle<v8::internal::Name>, v8::internal::Handle<v8::internal::Object>, v8::internal::StoreOrigin) [/usr/bin/node]
 | 20: 0xe190b6 v8::internal::Runtime_StoreIC_Miss(int, unsigned long*, v8::internal::Isolate*) [/usr/bin/node]
 | 21: 0x1448f59  [/usr/bin/node]
 | Aborted (core dumped)
 | error Command failed with exit code 134.
 | info Visit <https://yarnpkg.com/en/docs/cli/run> for documentation about this command.
 | `yarn start` failed with exit code 134

Hi everyone. Firstly, Growthbook is an extremely impressive system. Previously worked on a high scale proprietary experiment platform and GB looks a fantastic, credible implementation. Question I have is to what extent is GB run-aware? Let's say I start an experiment at 4/1/2023 000000 and keep it running for 3 days exactly. We find that the results we were getting were highly skewed towards the control and on analysis it is because there is a bug with the experiment. As such experiment was stopped, and bug fixed. Experiment restarted at 4/10/2023 000000. I have now two runs, 4/1/2023 -> 4/4/2023, and 4/10/2023 -> present. What is the default behavior going to be when calculating results? I want to make sure that the only data that is analyzed is for the current run alone, because the results that were part of the original run were biased because of the poor implementation. Initial analysis seems to be that runs / phases are essentially synonymous, and that I would have to manually delete a phase if it were due to a poor implementation. Is this correct? And is there a way I can force the system to only work with data collected for the current phase, as typically the only reasons I have for stopping and restarting an experiment is due to bugs, bad data collection, bias on traffic allocation - essentially reasons that would mean data collected during earlier phases / runs would be invalidated.

Hello, can I check if any other teams are facing any issues integrating GrowthBook to Slack on their self-hosted version? I followed the instructions and I am able to curl the incoming webhook. When I use the cloud-hosted version, I am able to send event notifications. But I am unable to do so on my self-hosted version.

Is it possible to resend a pending invite?

Hey all - I wanted to share some material that I created for a talk I gave last month at Columbia for a seminar on Online Experimentation: The Fundamentals of Building and Maintaining an Experimentation Platform. It's in shitty-first-draft mode but I came across GrowthBook while doing prep, and want to potentially expand it in a way that allows a reader to touch and poke it and understand how experimentation capabilities (and associated potential problems) grow. I'd be very happy to get y'alls feedback.

@future-teacher-7046 We are trying to run an A/A test here and for one of our cases we need to split the results by an user type. Since we use mixpanel we can not use the user properties to create dimensions, only event properties correct? To avoid adding this property to all events I am trying to see if we can find another way to achieve the same. For example, would it be possible to have two features with the same key and each targets one type of user so we can see the results separated by user type?

Hello everyone! I'm trying to pull growthbook docker image and getting the error: no matching manifest for linux/arm64/v8 in the manifest list entries Is there any image alternative for this one? I'm using MacOS arm64