Hi everyone. I am having a problem figuring out why I can’t edit my experiment description. Usually there is this “Pencil” sign for editing, but my new experiment (also created by myself) doesn’t have it for whatever reason

are there any known issues with Analysis UI on Running experiments? We're seeing this for all running experiments even though there is data in the underlying tables and up til today we were seeing the violin plots etc

I am having a problem I didn’t have before. When changing “Exclude In-Progress Conversions” to “Include In-Progress Conversions” - it doesn’t seem to affect anything. And when looking the underlying query, it still shows the “upper time boundary”, which in my undertstanding applies only to cases when Exclude In-Progress Conversions” is applied

image.png

Hi team! We noticed something odd in the experiments UI (see screenshot). We have an experiment ongoing where in the LD table variation 1 = Control variation 0 = treatment. That is how I setup on GB, but the UI (the bottom) is rather confusing about how exactly it actually got set up. Is this a known bug? Thx!

Hello! We would like to target specific app versions. Our in-house experimentation tool currently supports semver comparisons, and I think that’s the only missing feature in GrowthBook. Would it be feasible to add a new attribute type to enable this use case? For example, we could enable a feature or experiment for people using at least version 8.1.0 of the app.

Hey! I'm getting the error below when trying to "Adjust metrics" for an experiment. It seems to be related to some metrics generating an error, but I can't remove those metrics without adjusting the metrics... I'm also adding a screenshot from a colleague that might explain the error in more detail.

Application error: a client-side exception has occurred (see the browser console for more information).

Hey Team, congrats on the Slack integration release. I just tested it and it worked as expected! Small comment for future improvements: • There could be more information in the notification. Right now, it says "this feature was updated" but it would be nice to also have the notification tell you the environment + the change (at least for a toggle off or on of the feature flag, which are the changes that happen most often)

Hey growthbook team, Im using the force rule for a feature flag, and I think I found a bug. When I edit the rule it adds quotes to all the values, so I have to go into advanced mode and remove them for it work since the ids in my app are numbers.

Hi GrowthBook, I see a small bug in the ‘namespaces’ page. The URL if I click a feature links seems to be wrong; it is …feature/my-feature but I think it should be …features/my-feature? The link at present doesn’t work.

Hi there! How are you? I'm experiencing an issue with my dev environment, using growthbook feature flags. In my local environment, everything works as expected: growthbook loads correctly, feature flags are read as expected and its values changed whenever I change them on the dashboard. The problem is when I use my dev environment: growthbook loads correctly (this means that the connections is successful), but feature flag values are always

null

. I've already tested changing the connection SDK, but it happens the same. How can I proceed in this case? Let me know if I can give further details

Hiya, I saw that the Visual Editor 2.0 was available on GitHub so updated my local GrowthBook (via docker-compose). It doesn’t seem to work, am I missing something? When I create a new experiment and choose “Use Visual Editor”, I do not get any opportunity to use the visual editor and the expected “Advanced Mode” URL targeting link doesn’t appear?

I’ve started getting this error all of a sudden, using Growhbook cloud

Hi, I'm using GA4 to collect data, but I didn't get the expected results after following the tutorial. The issue I encountered is that no data was collected in BigQuery, and there was no growth_book_js table as shown in the tutorial. I'm wondering if the tutorial omitted some steps? Is Rudderstack necessary to use GA4?

Hiya, I’m liking the new Visual Editor but I’m not sure the Dev Tools are interacting with it correctly? It seems to show variation 0 regardless of which variation is selected? I uninstalled the GrowthBook DevTools extension and reinstalled it, no change.

Hey! Can someone help me with #mixpanel integration? I have a metric called "Content creation" where users can create multiple numbers of contents in the same day, like this value on april 1st: Why the value is so different? Config: Query:

Hi, wondering if anyone has ever requested the ability to use a condition on feature flags for

contains

eg.

if email contains @gmail.com

I'm aware this example can be done using regex but contains or does not contain would be nice to have also

Hi!. There’s seemingly something stange going on with the conversion window when setting up a new metric - I am trying to specify the conversion window at 168 hours but everytime I save the metric it changes to 143 hours. And than all of a sudden in changed to 142 hours.

After a couple of retries it finally “settled” at 168 hours.

Hi! When clicking on the Metrics "Edit" link in some experiments, we get this error:

Application error: a client-side exception has occurred (see the browser console for more information).

For other experiments, the pop-up opens just fine.

Having cohort-inside-cohort will be a nice feature to have

I am trying to figure out why the confidence interval isn’t shown for the revenue metric, is it because of the “suspicious result” notification or some other reason? Usually it’s because there’s not enough data, but when there isn’t, there is a notification that mentions it

This banner is persisting on top of experiments page for a feature flag that we've already archived. There was an experiment rule on it but we never made an analysis and don't intend to. Would be nice if there was the option to dismiss this banner (only button is "Start analysis") or if it would hide automatically for archived feature flags

Hello there, What is the best way to set the return for a metric that a host is viewed? ex: app.acme.com If an user visit then return as

1

?

Hi all, do youguys have any timeline for integration with Amplitude so I can analyse ab tests on Amplitude? https://docs.growthbook.io/guide#coming-soon

I seem to be unable to refresh queries when I look at experiments by dimension. first smell - it seems like the "update data" button is actually updating the underlying experiment but not the view by dimension. screen recording here - https://www.loom.com/share/a65db68a166c433792a8e97ce3f5db83 this appears to be broken for all our experiments right now, and for all dimension types.

For the past couple of weeks (at least), our results haven't been auto-updating. That means going through em one by one and refreshing them manually. I suspect this might be due to one of the experiments intermittently running out of RAM (a problem related to this issue). Maybe the auto-updater stops once one experiment query errors? But the others all work fine and none are auto-updating. I've verified auto-update is enabled and changed the value from 6 hours to 4 hours to see if that fixed something behind the scenes. I don't expect a quick bugfix, I just couldn't find anyone reporting on this. We love GrowthBook and the work y'all are doing. 🙂

In a recent experiment, we observed a notable contrast between users who were part of the experiment and those who were not. The biggest difference we saw between the in-experiment and out-of-experiment populations was in the percentage of new user accounts - there were significantly less 0D users (playing on the day of registration) in the experiment population, and more 1 year+ users. Is there a reason why this might have been the case?

Hi, we run Build: f58a91e (2023-03-31). When using the frequentist statistics, we still get the Bayesian behaviour for the metrics (see screenshot). This means we can’t change the critical p-value for our results to be considered significant, as one could in previous versions. Is anyone else observing this behaviour?

Hi, we started to run into the issue

Please reduce your request rate. (Service: Amazon S3; Status Code: 503; Error Code: SlowDown;

when setting the

Experiment Auto-Update Frequency

for our experiments. We set the value to 48 hours and now that we have 5 running experiments (we expect this number to grow), we see query errors almost every time on the Auto-Update. Have other users reported similar issues? Do the Auto-Updates trigger all queries in all experiments in parallel? Or are there mechanisms in place to prevent request rate errors?