Hello i need an help on Growthbook javascript installation, does anyone know if is possible to have a .js source compatible with ES5? Thanks a lot, Carlo

How to perform MultiVariate or Multi Page Testing using Growthbook

Any example would be really helpful

Hi Team, i want to store variation id (default value) in local storage when user is not pushed into experiment. Is there any way to find out this time user is not pushed into experiment.

Hi team, trying to run 2 experiments mutually exclusive and set it up this way on Growthbook namespaces, however doesn't seem to work. I am getting headlines in the hero of the other experiment...any clue why this is happening?

https://docs.growthbook.io/app/features#namespaces talking about this feature

@fresh-football-47124 thank you so much for your time today, and the engineer whose name I sadly didn’t write down. I’ve updated my local instance of GrowthBook to Build: 18664dd (2023-05-03) but my visual experiment still isn’t showing results. This is the experiment query:

-- Counter button clicks (count)

WITH

__rawExperiment as (

SELECT

user_id as user_id,

TIMESTAMP_MICROS(event_timestamp) as timestamp,

experiment_id_param.value.string_value AS experiment_id,

<http://variation_id_param.value.int|variation_id_param.value.int>_value AS variation_id,

geo.country as country,

traffic_source.source as source,

traffic_source.medium as medium,

device.category as device,

device.web_info.browser as browser,

device.operating_system as os

FROM

(

SELECT

*

FROM

``analytics_xxx.events_*``

WHERE

_TABLE_SUFFIX BETWEEN '20230403' AND '20230505'

UNION ALL

SELECT

*

FROM

``analytics_xxx.events_intraday_*``

WHERE

_TABLE_SUFFIX BETWEEN '20230403' AND '20230505'

),

UNNEST (event_params) AS experiment_id_param,

UNNEST (event_params) AS variation_id_param

WHERE

event_name = 'experiment_viewed'

AND experiment_id_param.key = 'experiment_id'

AND variation_id_param.key = 'variation_id'

AND user_id is not null

),

__experiment as ( -- Viewed Experiment

SELECT

e.user_id as user_id,

cast(e.variation_id as string) as variation,

CAST(e.timestamp as DATETIME) as timestamp,

CAST(e.timestamp as DATETIME) as conversion_start,

DATETIME_ADD(CAST(e.timestamp as DATETIME), INTERVAL 72 HOUR) as conversion_end

FROM

__rawExperiment e

WHERE

e.experiment_id = 'new-secondary-panel-title'

AND CAST(e.timestamp as DATETIME) >= DATETIME("2023-04-03 17:53:00")

),

__metric as ( -- Metric (Counter button clicks)

SELECT

user_id as user_id,

m.value as value,

CAST(m.timestamp as DATETIME) as timestamp,

CAST(m.timestamp as DATETIME) as conversion_start,

CAST(m.timestamp as DATETIME) as conversion_end

FROM

(

SELECT

user_id,

user_pseudo_id as anonymous_id,

TIMESTAMP_MICROS(event_timestamp) as timestamp,

1 as value

FROM

``analytics_356435236.events_intraday_*``

WHERE

event_name = 'Click counter button'

AND _TABLE_SUFFIX BETWEEN '20230328' AND '20231231'

UNION ALL

SELECT

user_id,

user_pseudo_id as anonymous_id,

TIMESTAMP_MICROS(event_timestamp) as timestamp,

1 as value

FROM

``analytics_356435236.events_*``

WHERE

event_name = 'Click counter button'

AND _TABLE_SUFFIX BETWEEN '20230328' AND '20231231'

) m

WHERE

CAST(m.timestamp as DATETIME) >= DATETIME("2023-04-03 17:53:00")

),

__distinctUsers as (

-- One row per user

SELECT

e.user_id as user_id,

cast('All' as string) as dimension,

(

CASE

WHEN count(distinct e.variation) > 1 THEN '__multiple__'

ELSE max(e.variation)

END

) as variation,

MIN(e.conversion_start) as conversion_start,

MIN(e.conversion_end) as conversion_end

FROM

__experiment e

GROUP BY

e.user_id

),

__userMetric as (

-- Add in the aggregate metric value for each user

SELECT

d.variation,

d.dimension,

d.user_id,

SUM(m.value) as value

FROM

__distinctUsers d

JOIN __metric m ON (m.user_id = d.user_id)

WHERE

m.timestamp >= d.conversion_start

AND m.timestamp <= d.conversion_end

GROUP BY

d.variation,

d.dimension,

d.user_id

),

__stats AS (

-- One row per variation/dimension with aggregations

SELECT

m.variation,

m.dimension,

COUNT(*) AS count,

SUM(COALESCE(m.value, 0)) AS main_sum,

SUM(POWER(COALESCE(m.value, 0), 2)) AS main_sum_squares

FROM

__userMetric m

GROUP BY

m.variation,

m.dimension

),

__overallUsers as (

-- Number of users in each variation/dimension

SELECT

variation,

dimension,

COUNT(*) as users

FROM

__distinctUsers

GROUP BY

variation,

dimension

)

SELECT

u.variation,

u.dimension,

u.users AS users,

'mean' as statistic_type,

'count' as main_metric_type,

COALESCE(s.main_sum, 0) AS main_sum,

COALESCE(s.main_sum_squares, 0) AS main_sum_squares

FROM

__overallUsers u

LEFT JOIN __stats s ON (

u.variation = s.variation

AND u.dimension = s.dimension

)

Here’s a screenshot of the SELECT in BigQuery, and a screenshot of the experiment in GrowthBook. Is there anything else you can suggest for me to try?

Hiya! So we've accidentally started an experiment with a feature rollout rule instead of an experiment rollout, which means we don't have tracking for who is assigned to which variant. Is there any way to view the ids that have been included in the percentage rollout anywhere via Growthbook? Or to start an experiment rollout going forward without compromising the previously assigned feature rollout customers?

Hi guys, I am still getting issues with running mutual exclusive experiment - I am not 100% clear how split works, does anybody have experience and could help me fixing the experiment?

Hello, I am getting an issue. When I route from page A to Page B the feature flag is not setting, it is setting false. But when I refresh the page the flag get set. I am using react sdk

Do you host a feature roadmap somewhere? Would be good to know when critical features are coming out

hi all! my company has just started using growthbook and started with a set of 10 A/A tests. we noticed right away that the group assignment does not seem to be independent across the tests. The tracking keys are very similar -

aatest_1

,

aatest_2

, and so forth. is this expected behavior?

Hey are you planning on supporting force rule manipulation via API? Similar to the feature toggle endpoint, but ability to toggle a force rule for attribute value. Use case is for automated QA, they want to be able to switch a feature on just for a specific user in production, then switch it off again.

Hi folks, Does exists any way to configure HTTP Header on the request for React Native SDK? It is to make some verification on our API gateway in front of the GB instance. The main idea is avoid the use of custom integrations so we don't lose the auto refresh and another SDK features.

Hi All! I tried to run growthbook-proxy in the ECS but I received this error below: {"level":50,"time":1683239035672,"pid":30,"hostname":"ip-xx-xx-xx-xx.ec2.internal","err":{"type":"HTTPError","message":"Response code 401 (Unauthorized)","stack":"HTTPError: Response code 401 (Unauthorized)\n at Request.<anonymous> (/usr/local/src/app/node_modules/got/dist/source/as-promise/index.js11842)\n at processTicksAndRejections (nodeinternal/process/task queues96:5)","name":"HTTPError","code":"ERR_NON_2XX_3XX_RESPONSE","timings":{"start":1683239035652,"socket":1683239035652,"lookup":1683239035652,"connect":1683239035654,"secureConnect":1683239035659,"upload":1683239035659,"response":1683239035672,"end":1683239035672,"phases":{"wait":0,"dns":0,"tcp":2,"tls":5,"request":0,"firstByte":13,"download":0,"total":20}}},"msg":"polling error"} I set the env GROWTHBOOK_API_HOST, SECRET_API_KEY and GROWTHBOOK_API_HOST part of growthbook proxy , in the growthbook (API and UI ) I set env - PROXY_HOST_PUBLIC and SECRET_API_KEY I created the DNS in route53 aws for url api and ui. Could you please help me? Is there some configuration I need to do?

👋 Hey GrowthBook your product is sweet.

How growthbook can be setup below alb. i have launched growthbook via docker , now want to ssl via aws alb ? how we can do that ? any doc for reference.

Hi everyone! I am the CPO at a somewhat large company (about 10 million sessions per month) and considering GrowthBook for our upcoming NextJS/RoR platform. Trying to understand how stable/reliable GrowthBook will be compared to paid options (Split.io, VWO… and so on..) any comments? Thanks a lot!

Hi, is anybody able to work with Dimensions with Mixpanel as source?

We are planning to upgrade our self hosted app from

v1.7.0

to

v2.1.0

. Should we just update the docker file with new version or is there anything do like migrations for MondoDB and all?

Hi team, I'm seeing an issue with the visual editor 2.0. I created an experiment but it works in some browsers and doesn't in some. On browsers I've tested, it works in brave, safari and not in firefox and chrome. If I use the preview link it works on all browsers.

Hi! I've wanted to make some changes in the queries of my experiment, but not lose the original one, so I've duplicated my experiment, and hoped to see the same results from the original one, and only then do the changes, but unfortunately I don't see any results. What am I missing? how do I do what I've described? thanks!

Hello! Is it a good idea to use GrowthBook for entitlements [1] (as replacement for Oso [2])? https://arnon.dk/why-you-should-separate-your-billing-from-entitlement/ https://www.osohq.com/docs/guides/model-your-apps-authz#entitlements For example, Feature1 is ON if

user.organization.plan == 'pro' and <anything else…>

We are getting users enrolled in experiment with feature flag off and experiment rule disabled. Have you guys seen this?

Hello! I want to use growthbook to run experiments on type of product recommendations/promotional campaigns across push & pull channels. For e.g. I want to test Product + price + image/content on our app ; Product + price + script copy on push channels such as sms app.I want to understand if this is feasible

Hiya, just checking the pricing if we didn’t want to self-host but instead wanted to use the GrowthBook hosted app so we wouldn’t have to keep a server running 24/7 to bucket users, configure and analyse experiments etc. $20/USER/MONTH would buy us Pro level, is that right? And can you give any ballpark for Enterprise level, as we might want to move to that in future? https://www.growthbook.io/pricing

Hi everyone , if i'm already running an a/b test experiment and i decided to start using namespaces with the same experiment , would it cause users to switch variants ?

How to force a user to be in the treatment group for an experiment? Write an entry in the exposure table of the database?

Hi everyone. I am happy to see that you implemented bonferroni-holms corrections in your stats engine. However, there’s one question I have. Is there some confidence interval adjustment going on as well? Since we adjust p-values to account for multiple testing, there should also be some adjustment for confidence intervals as well, but I’m not sure I’m seeing one

Another question on the same subject, but this time somewhat unrelated to GrowthBook itself. If I want to analyze users by language (8 segments) and by device (3 segments: mobile, tablet, desktop), should I make a correction for overall 11 segments or should I correct separately for device (3 comparisons) and language (8 comparisons). I feel intuitively that the correction should be made for 11 overall segments. I am assuming Growthbook makes correction within the attribute and not across all values of the attributes?