Two items I couldn't find any documentation for but would like to understand how they work exactly: 1. Activation Metric 2. Type of Phase (ramp, main, holdout)

Hey! Can I read something about security?

Hey. I'm getting an error after trying to preview metric data and clicking "Run Analysis": Error: Cast to embedded failed for value "{ d: Invalid Date, v: 0, u: 138, s: 0 }" (type string) at path "analysis.dates" Any ideas why?

hey guys i have a question around logged in/logged out users

# segment_user_key => anonymous_id/user_id
  # segment_user_id => anonid/current_user.id
  #
  def analytics_event_tracking
    Analytics.track(
      event: 'Experiment Viewed',
      segment_user_key => segment_user_id,
      properties: {
        experiment_id: experiment.id,
        variation_id: experiment.variation
      }
    )
  end

we were using this code in the backend to fire the experiment viewed event. My comment above shows what those values can be of course - what happens here though is we are potentially losing the context between logged in and logged out users. If somebody comes to the site, triggers an Experiment Viewed event while logged out, registers - then their user key/id will change (now its the logged in version) and so the goal when triggered will be presumably not be measured as it can't be matched? If we instead always use their logged out key - we lose the ability to track them across devices? That said, while looking at the docs https://docs.growthbook.io/lib/ruby#tracking I see that you recommend not sending user identifiers at all. Is that because if we kick this to Segment they'll just handle all of this? Send the logged in/logged out ID's and the query on your side looks for both? Be good to understand this a little more to make sure our implementation is bullet proof

The second phase of our redesign was just deployed. Please let us know of any issues.

Just logged in into Slack to thank you for the new design. Looks slick!

Is it a correct assumption that I won't be able to see experiment results until I have at least one conversion in each group? I checked the underlying SQL query that calculates the conversion rates for each group and that's what it looks like

New GrowthBook Version (0.8.0) We are excited to announce the release GrowthBook version 0.8.0 which includes some large improvements and features:All new design!The design of GrowthBook got an overhaul from top to bottom, with new navigation, colors, and layout to improve the user experience. Try it out on our cloud version.Up to 10x faster statistical analysesWe greatly reduced the number of roundtrips...

Hi, first of all, congrats, it´s a wonderful project! I would like to have some help as I am getting an error message when updating experiment metrics

thoughts?

It seems it´s taking a while for the https://cdn.growthbook.io/config/key_zzzzz call to return the latest experiment overrides. In my case, Cloudfront it returning a cache hit from the call, with a response that is not the most up to date, so I presume you are not purging cache but you are are letting current cf cache to expire. I am right?

Hi. When creating a new presentation, I can´t select Archived or Running experiments. I think only stopped experiments are being shown

Is there a way to run a multivariate test with the platform? It seem I've seen docs about it but can't find them anymore

Any way to get the ID of an experiment out of a webhook or the API? We'd like an immutable reference to experiments and the tracking key can always be changed.

There seems to be a mismatch between query dates and graph labels

👋 Hi everyone!

Hello ! I guess there is an issue here. The condition failed since it should be a

==

instead of

=

. Here, I'm using a Mixpanel event property in my metric.

It looks like https://app.growthbook.io/ is really slow

Hi guys, For one of my ab test I'm not able to Query the results. I got this error. My source is Mixpanel

Hey guys! Can you tell me about your A/B testing mechanisms? How it count? Didn't find in the documentation

Hi everyone! Lately I've been looking at Growthbook, and I'm really interested in doing a POC with it within our company. One question that I have is regarding the way Growthbook needs to be configured against its datasource. Am I correct that the backend only really requires read-only rights to the datasource (e.g. Snowflake in our case), as long as we have the necessary data to perform the experiments and pageviews query?

Hi! Can't find where I can setup northstar metrics in the interface (Cloud-hosted growthbook). This article mentions them and provides an example screenshot, but fails to tell how I can configure them.

I am trying to figure out the segments functionality. While I've managed to successfully setup a segment, I am somewhat concerned about how they work exactly. I am seeing users are joined with their segment data by user_id only, but user properties change overtime, sometimes with every pageview.

JOIN segment s ON (s.user_id = u.user_id)

In my data source configuration, I already have some user properties that are used in the experiment analysis and are pageview-level. Wouldn't it make sense to have user properties as a part of the pageview query?

SELECT
  user_id,
  timestamp,
  url,
  has_orders,
  lang,
  country
FROM pageviews

In which case it would me much easier to calculate the estimates for an experiment based on pageviews by just filtering pageviews with certain user properties. Looks like I can achieve more precision by editing this query

SELECT
  u.user_id,
  MIN(u.conversion_end) AS conversion_end,
  MIN(u.session_start) AS session_start,
  MIN(u.actual_start) AS actual_start
FROM
  __users u
JOIN
  segment s
ON
  (s.user_id = u.user_id)
WHERE
  s.date <= u.actual_start
GROUP BY
  u.user_id

When I change <= to simple "=" , I only join user properties which were observed exactly on viewing specific page and not before that.

at this moment it's the same number as the one shown along with the "1st week retention" metric

Hi quick question about the growthbook analysis, When you run an experiment you can see the queries being run but i assume some additional logic is running under the hood, how extensive is this ?

👋 Hi everyone! i'm tring to add Data Source in growthbook i'm getting error , i tried multiple time with different databases

Estimating total lift from a change: Is there a way natively get estimations of the total expected lift from some change. e.g. if we have some experiment and say the experiment is showing a 13% improvement, is there a way to say that ok with

n

eligible users and a current rev per user of

k

we’d expect a lift of

n*k*.13

This is something we could do backend pretty easily but i was wondering if theres any features built in to do it or if alternatively someone else has a clean implementation ?

Hi everyone! I'm new to the platform. I'm trying out Google analytics as a data source. Aside from the "1 experiment at a time" limitation, are there any other downsides to it?

Hi. I've applied a segment in the experiment analysis settings and trying to figure out how it's applied to the experiment audience. I can see that the segment is joined with the experiment users data but can't see how it's used

__distinctUsers as (
  -- One row per user/dimension
  SELECT
    e.user_id,
    'All' as dimension,
    (
      CASE
      WHEN count(distinct e.variation) > 1 THEN '__multiple__'
      ELSE max(e.variation) END
    ) as variation,
    MIN(e.actual_start) as actual_start,
    MIN(e.session_start) as session_start,
    MIN(e.conversion_end) as conversion_end
  FROM
    __experiment e
    JOIN __segment s ON (s.user_id = e.user_id)
  GROUP BY
    dimension,
    e.user_id
),

There's seemingly no reference to the semgent data later on in the query

Hi, I've been evaluating this platform for our company and it looks amazing! One thing I'm not clear of is the usage of 'Segments'. Is it simply just to filter the data? Can it be used for targetting too?