👋 We've been getting SRM errors, but really struggling to understand why or what to do about it

Hello yall

Is SSO in OSS?

Hey guys, I am experimenting with GrowthBook for feature flag experiments on android, and I seem to have hit a roadblock. I have created a feature, set up an experiment that affects all users, split them by

id

, 50%-50%, and whatever I do, I only seem to be able to receive

defaultValue

, instead of the expected overrides (all the users are included in the experiment). Details in thread, do I miss something?

How long does it take after creating a draft experiment for the preview to be available? (ref: https://docs.growthbook.io/app/visual#qa) I’m trying to debug if my visual experiment is configured incorrectly, or if I just need to wait for (hosted) growthbook script to kick in

Can We directly set some values(attributes) if user is part of experiment and some other values(attributes) if not part of experiment from growth book directly? or do we will have to externally built this conversion layer. It will help our feature settings to be more dynamic. Can someone help? Basically if it under the experiment (A): then A ->{"key":"value","key":"value"}.

Hi team, I found something weird in the metric conversion time queries generated by GrowthBook (it might just be I’m not totally understanding it): Let’s say I define a metric with

Conversion Delay = 0

(i.e. I want all the metrics with

metric.timestamp

>=

experiment.creation_timestamp

to be included in the query) and with

Conversion Window = 72

(i.e. I want to keep just the metric entries with

metric.timestamp

<=

experiment.creation_timestamp + 72 hours

). There is a point in the query, where happens this:

__denominator0 as (
  -- Metric (metric name)
  SELECT
    user_id as user_id,
    1 as value,
    m.timestamp as conversion_start,
    m.timestamp + INTERVAL '72 hours' as conversion_end

where this

m

table refers to the metrics table, therefore

m.timestamp + INTERVAL '72 hours'

will be 72 hours after the metric timestamp, rather than the

experiment.creation_timestamp

. I think the logic is still working fine, but I’m not sure if this calculation is properly defined. If it helps, the code is: https://github.com/growthbook/growthbook/blob/3ca3d6ec5e0ac4451b088ff6d399fa2f2cecf268/packages/back-end/src/integrations/SqlIntegration.ts#L6[…]709 Many thanks and please let me know if something I’m saying is wrong or my assumptions are not correct!

Hey there! 👋 I’m trying to understand (i.e. replicate in a spreadsheet) how the

Chance to Beat Control

and

Risk of Choosing

statistics are calculated. Is there a toy example that shows how these calculations are done? (say on a sample dataset)

Hi, I have a question on splitting traffic before assign users to AB Testing. The setup is, I want to run AB testing on a certain percentage of users for risk management. I see there is a config in an AB Testing setup screen. the

Percent of traffic included in this experiment

. Can I use this setting to to setup my experiment? For example, I set the traffic percentage to be 50%, does it make my A/B splits to be 25%/25% of the overall traffic?

Hi guys, I am attempting to experiment with GrowthBook and have cloned the growthbook repo https://github.com/growthbook/growthbook#:~:text=Get%20up%20and%20running%20in%201%20minute%20with%3A. I haven’t been able to get passed this error even though I updated the

JWT_SECRET

environment variable with a JWT token

ERROR (UnauthorizedError/59 on 1fe8540a388c): ERROR /user
 |     UnauthorizedError: invalid signature
 |         at /usr/local/src/app/node_modules/express-jwt/lib/index.js:105:22
 |         at /usr/local/src/app/node_modules/jsonwebtoken/verify.js:133:14
 |         at getSecret (/usr/local/src/app/node_modules/jsonwebtoken/verify.js:90:14)

Hi, Can someone please point me to the code that does Suspicious Uplift Detection.

Suspicious Uplift Detection which alerts you when a metric changes by too much in a single experiment, indicating a likely bug

https://docs.growthbook.io/statistics

Hi! I try to use the Growthbook Chrome extension but nothing happen when I click on it. Can someone help me please?

Is it possible to host Growthbook and Growthbook’s API in a single domain? The documentation for APP_ORIGIN and API_HOST specifies them to be different, but I wonder if I can host them in one domain but using a separate prefix instead (e.g. my-growthbook.com and my-growthbook.com/api)

Hi! If I update the traffic split of an ongoing AB-test from the features section in growthbook. Will the running experiment automatically account for this when doing the analysis? Or will I also have to start a new phase from within the experiment tab? Thanks in advance

Hi everyone! We need your help with metrics: What the problem: when we created new metrics, that take data from a custom data source (this datasource was founded on Amazon Athena) we see the results, who have the biggest difference with a true result (when we used SQL script for calculated some metrics directly in AWS) For example: • count distinct bets: in datasource, whose connected in Growthbook and have 100% info about exp(2000000 bets for every exp_group, calculated metrics GB give us 25-30% (500000 max for every exp_group) • turnover has the same situation We researched GB SQL query for every metric, but didn’t find the problem - changing conversion params on page “Behavior” didn’t help Maybe someone has a similar case and can help us?

Hi again! Quick question: is there any way to stratify the random assignation using a variable different from the one used to randomise? Let’s say we want to randomise by

user_id

, but keeping the same proportion of users from each

country_id

in each of the variants. Is this something Growthbook allows out of the box? Otherwise, is there any easy way to implement this on top of current GrowthBook randomisation process? Thanks a lot! cc @little-cpu-3178

Hi - We are looking to self host Growthbook for a POC, and will host the required components in Azure. Is using Cosmos DB or MongoDB Atlas on Azure instead of a standalone Mongo DB instance a tested and valid configuration ?

Hey! We've been using Growthbook for a little bit now with our Google Analytics UA implementation for A/B testing experiments, and it's been so great that we'd like to start running multiple, concurrent experiments. Per the docs, this isn't possible in universal analytics (although I supposed we could add a second experiment dimension), but it should be possible in GA4, as it doesn't seem to have the new limits. We're in the process of setting up GA4, but it's not clear to me how we can run concurrent experiments? Does anyone have any suggestions or resources for how to do so? I've looked for documentation, but not seeing anything so far. Thanks!

Hi all - Just trying to get to grips with the newish C# SDK - I'm struggling to populate the features dictionary in Context with the API response JSON. Does anyone have a code snippet that could help, there doesn't appear to be any documentation ?

Hey! Is there a way to add features through the API? We would really love to have that feature. When we create a new project, we want to populate with some features. Is there any way to do this?

Hi @fresh-football-47124, my name is Rupin and I'm interested in an experimentation platform for iOS, Android, and Web. I would love to understand pricing and how are you different from Optimizely. A friend of mine told me to check you all out

Does updating the active attributes mark the end of an experiment? or will events after attribute changes still apply to previously viewed experiments? To be more specific: we have an Add to Cart metric that we are using in an experiment that is only visible on certain products. Every page view changes the

route

attribute. We are wondering - does the Experiment Analysis of Add to Cart include any Add to Cart that occurs after the experiment has been viewed, or only if the Add to Cart occurred on the same route?

Does rollout decrease move user from B to A? Like I have feature roll out initially with 10% users and user X fall into A and then I increased to 100% now user X moved to B group after some time I have decreased roll out to 10%. here does user X get A or B ?

Hi All - When self-hosting, is it possible to configure SSO/SAML, for user logins to the UI ?

Hi Guys, does anybody have experience setting up reporting of GrowthBook experiments in GA4? We've set up custom dimensions in GA4 to retrieve the properties send by GrowthBook, through Rudderstack. The event

viewed_experiment

and properties (

experiment_id

and

variation_id

) seem to come through in the default event report, but within a custom report (explore) it only returns

(not set)

values. Does anybody know how to get the values in a GA4 report, so you can analyse on various metrics and compare Control and Variation?

hey! after last update some configuration of text were lost. Look at ==flight==. Earlier it was looks like tag, but now like this

Hi, today we have updated GrowthBook from 1.4.0. to 1.6.0. and since the update we are getting the following error after some time logged (20 min. aprox.):

An error occurred: Format is Authorization: Bearer [token]

How can we fix it?

Hello all! We are doing a simple A/B test where we are measuring the impact of sending an email. One of the metrics we are measuring is revenue per user. The test has been running for sometime. Although I see there are users conversions for each day for each variation, for some reason Growthbook doesn't capture it for some days (see below). Was wondering if anyone knows what am I missing?

Hi all! Been using growthbook for about 1 month and loving it so far! I have a question about a “compound” rule and would love to get some takes here. There’s a feature in my app that is behind a flag. I need to flag to be enabled at a company level, but grant additional permissions within that flag to only certain users in that company. My first thought was to create two flags, and have the first one govern the feature and the second one govern user access but I was wondering if that was best approach here or if I’m missing something. Thanks in advance!

Is there a way to filter the metric query based on the experiment name? we store all our conversions in a single table inside BigQuery, so ideally I’d like the metric query to be like

select user_id, value, timestamp
from metric_table
where experiment_name = '{{ experimentName }}'

So that I can just use one Metric for all experiments. Right now it seems I need to duplicate the metric for each experiment since I can’t templatise it based on the experiment name, but not sure if I’m missing something.