hey, instead of providing feedback I would ask your comments about my PR 😅 This is the last major issue blocking full adoption of growthbook in our org: https://github.com/growthbook/growthbook/pull/925

Hey GrowthBook team! In the "Add Experiment" module, the table that comes up with a sort of preview of the experiment data shows a column labeled "users" (see screenshot). From my understanding, this isn't the unique users per cell, but rather the count of the rows in each cell found in the Experiment Assignment Query, which could have a separate row for each time the user views the experiment. Is this right? If not, where is the best place to define each user's exposures to the experiment (for purposes of the Attribution Model)?

Heads up that the clipboard icon/copy feature doesn’t seem to work—I’ve tried it on the metrics page and the pop-up to view the results query. This is the error in the console:

Uncaught (in promise) TypeError: Cannot read properties of undefined (reading 'writeText')

We are currently in the process of defining new metrics in GrowthBook and found that currently there are only two versions of continuous metrics, either it is time or US$. We would love additions: • being able to set our own currency • a metric version that is continous and has no unit. Examples for this could be Overall Evaluation Criteria that are computed from other metrics and have no unit interpretation or something like Cumulative Layout Shift that is part of the web vitals.

Hi! What is the maximum number I can use If I set the attribute data type to "Number" in GrowthBook. 😀

Hey, for one of our a/b tests the tracking within the experiment seems to be broken – is there anybody that could help me?:)

Hello. I have been using Growthbook for our analysing our experiments and one of the analysis seem to behave weird. This experiment has run for a few days, but the violin plot is just one line at the center, the Chance to Beat is always 50%, and the risk of choosing either control or variant is always zero. We already have quite a number of users and the mean of the metric is quite different for the variant as compared to the control. I wonder how I can troubleshoot if there’s anything we did wrong in the way we set this up.

I’m having a problem setting up Northstar Metric panel - it remains empty regardless of what metric I choose. I guess it may have something to do with the fact that I also can’t choose the data source for the metric.

Hi all — We’re wondering whether other companies have tried running a Growthbook test on a landing page for first time users. We have had issues with glitches when we used growthbook plugin clientside (because we do everything via server side rendering, so the page glitches because it first shows control then client side switches to test cell). Our stack is Nuxt with Vuejs. Does anyone have suggestions for how to proceed?

Is there a way to automatically stop an experiment when certain number of users has been reached? We want to make sure that experiments don’t run longer than needed and automatically stop when the required sample size has been reached.

Hi team, our product analysts have reported to us that after 2/3 days of uploading screenshots in the experiment template, they disappear. Is this a known issue? Thank you for your time 🙂

Hey guys, we are using namespaces for two features and one feature also has a traffic limitation. We have a 50/50 namespace traffic split and want to include only 20% of traffic for the other feature. I saw now that because of the namespace, the total traffic for the feature with the namespace and the traffic limitation was reduced to 10% → I don't understand why this is necessary?

It seems that there's no way to open rows in a new tab - command-clicking opens them in the existing tab, and as there's no actual anchor/href, right clicking doesn't offer the usual link options either That means if you need to go through and update hundreds of experiments, tens of metrics, etc, it's a bit of a nightmare to do (and the selected tab/filtering/search is lost when you go back too)

If there's only one experiment assignment table, maybe the option could be removed, or at least have it default to the right option?

Hey team! By any chance is there a changelog for the javascript SDK across release versions? 🙏 We've been using growthbook 0.18.0 on a graphql instance and we recently noticed non-deterministic experiment results (based on user id), wondering if I could see a list of fixes that happened between 0.18.0 and the most up to date 0.21.2

Is there some p_value correction going on when looking at the results using Frequentist engine? Seems like p_value changes radically when I update report

A colleague of mine found and reported a bug that affects the numbers in the results table and that you might want to solve quick: https://github.com/growthbook/growthbook/issues/1057

Bayesian methods offer some distinct advantages over the frequentist approach. In order for frequentist methods to be valid, you must decide on the sample size in advance before running an experiment---a fixed horizon. (from the docs)

Bayesian vs frequentist , I know, I know) Just commenting one thing - calculating minimum nobs in frequentist approach let you get the exact numbers for Type 1 error and for Type 2 error, (sort of) exact numbers for minimum detectable effect and therefore clear algorithm for making decision in order to avoid people asking "so when should I decide which variation has won?".

Hi GB Team! It would be really cool if we could archive metrics directly from the metrics catalogue rather than having to click in each of the metrics and the three dots menu on the top 🙇‍♀️ is this something already on the radar? 🙂

Hiya! One thing I'd love to see is the ability to dynamically calculate and filter or cap outliers within experiment metrics. I find myself often having to do this using the queries outside of Growthbook and then going back in and adding it to the metric - which is 100% doable but just adds additional steps that could be automated ✨

Hi folks, I was wondering if there were any plans to expose tags via the API or add grouping functionality to feature flags. Say for example, you have the SDK running on the server and want to pass all front end flag values to the client. It would be handy if these could be tagged

front-end

in growthbook, the tags sent with the feature rules, then the server could filter for just the front end flags, loop over and evaluate them, and then send them on.

Hi all, thank you for creating GrowthBook - it seems like fantastic quality and value. It's a minor thing but it would be nice to have the option to use camelCase for flag names. As our code base is all Javascript (Ionic/Angular app for web, iOS, and Android), we've tried to standardize on camelCase for event and user properties with Amplitude and GA4. Currently, when you add a camelCase feature to GrowthBook, it seems to save it in all lowercase. Admittedly we may be swimming upstream trying to have javascript-style naming conventions, but I wanted to add this as minor feedback. Thanks

Hi! I’m wondering whether there are plans (or current ways) to post the current results of a test in Slack on a daily or weekly cadence? This would be awesome to keep the team informed about progress

Hi all, we are noticing that cancelling a data refresh in GrowthBook does not cancel the query in our Snowflake warehouse. Is this something that can be fixed?

👋 Since yesterday, i can no longer change the current organization because the header dropdown is not clickable anymore Same thing happens for other elements in the header. (Edge browser)

🆘 Hello - does the GrowthBook team offer dedicated implementation support at an additional cost? We are in need of assistance and cant seem to make any progress.

Hey, I ran into a problem when using the following condition:

{
  "$or": [
    {
      "userId": {
        "$type": "undefined"
      }
    },
    {
      "userId": null
    }
  ]
}

If the userId was defined, it would throw an error because of the second part. I am not sure this is intended behaviour since this is a valid MongoDB query

Hey team! Is it possible to expose the variant name for tracking purposes? While variant IDs are useful and can be used as a fallback, having a more descriptive identifier in our data warehouse would be beneficial. Would you be interested in this? If so, I can take a deeper look into the codebase and open a pull request.

Are there any plans to integrate more closely with Segment (i.e. Audiences)?

Hey! We would love if the experiment list is something that can be exported / downloaded in CSV (related issues #1109 and #607) ❤️ 🙏