Hi all, I have a few questions about email notifications. Firstly, to my knowledge we never set these up but I received two emails about stat sig results after updating to the latest release of GB. Other watchers of the experiment didn’t receive them. Where can we edit the settings around these emails? Second, I received an email saying one of my goal metrics reached significance (see first screenshot), but when I checked the dashboard, it had different results (second screenshot). We only collect data once every morning, so even if the dashboard was updated after the email was sent, there would have been no new data. Any ideas why the email differs from the dashboard?

I'm forwarding the issue to our team

Thanks!

Hey Julianna. I wonder if there's a bug where this is firing when there is an analysis run with dimensional breakdowns.

Hi thanks for the help! That must have been it - there is one level of one dimension that’s unadjusted p-value matches the one from the email. But the adjusted p-value is much higher than .05, but I guess that’s not what the email is based on. Anyways, yeah we would prefer not to get emails for the dimensional results

Yes, we are landing a fix to turn this off now, but getting the fix would require upgrading when it lands.

Anyways, yeah we would prefer not to get emails for the dimensional results

Is there a place I’m not seeing to turn off the emails?

Let me check quickly. I have to head out soon.

Thanks!

There isn't a way to turn them off. But we just landed another change that should mean that watchers only get emails when a scheduled update for an experiment runs, not when you click the update results button manually. This has been the behavior for a long time. We want to add more customization later, but if you could upgrade and let us know how things are looking that would be helpful.

Hmm no one on our team has received any email before yesterday - should we have?

Only if you had scheduled updates. Manual updates (clicking "refresh" in the UI) never triggered emails, until the bug you reported to us (which we now have resolved).

Oh interesting. We’ve had scheduled updates on for months (possibly a year?) and never received an email

Hmm, that flow is old and that's why we're working on it now.

where can i find the release with the bug fix?

The

latest

release will have it. Or any docker image (if you're using Docker to upgrade) from Friday or later.

ok thanks

No I don't think that's intended. I'll take a look, sorry about that.

thanks!

That's a bug and a fix is underway. I'll let you know when it is available in

latest

thanks so much!

The fix is live in the

latest

release

hi @helpful-application-7107 we’re trying to update growthbook to get the bug fix but i’m not seeing any newer releases than 3.2.0: https://github.com/growthbook/growthbook/releases. did it come out with a version number? we’d like to update to specific version tags instead of the

latest

tag

Oh, sorry. It did not come out with a version number.