https://www.growthbook.io/ logo
#ask-questions
Title
# ask-questions
i

important-scooter-19137

04/18/2023, 10:54 AM
Just stumbled upon growthbook. What is the easiest data source to get and running for testing some custom stuff, that handles near realtime data at medium scale. Preferably one that comes with all js tooling needed to reliably track events. 15m pageviews a month or so.
f

fresh-football-47124

04/18/2023, 10:56 AM
Mixpanel is probably the easiest
i

important-scooter-19137

04/18/2023, 10:56 AM
Tested them some years ago. Super expensive. I think we have a Matomo instance running somewhere
Might be fairly easy. I guess rudderstack is the best one for real-time, but complex?
f

fresh-football-47124

04/18/2023, 10:57 AM
With sql based data sources, the complexity is similar
We create the initial queries for both matomo and rudderstack
Of those, rudderstack is probably better
i

important-scooter-19137

04/18/2023, 10:58 AM
So basically what growth book does is to pull out all events and do the significance calculations and stuf on your end?
f

fresh-football-47124

04/18/2023, 10:58 AM
The data structure of matomo is quite strange
Yes- for the experiment reporting side
We also have SDKs and a full feature flag system too, and a visual experiment editor
i

important-scooter-19137

04/18/2023, 11:01 AM
Basically just ran around looking for an ab testing api, without much gui other than reporting. Basically looking for two things without having to build everything. Testing a hierarchy of variations, so variation1 has some subtests for different elements. Which I guess should be ok to do by just prefixing tests. And testing sitewide and being able to combine results by some criteria. For example testing 3 types of headers on all products where one is "happy" one is "plain" etc, and then be able to segment those based on some product attribute to see if there are significance on specific attributes
I guess the last thing there is outside the scope of GrowthBook and the built in reporting?
f

fresh-football-47124

04/18/2023, 11:03 AM
You can use GrowthBook for just experiment reporting
Many do
i

important-scooter-19137

04/18/2023, 11:04 AM
But is it flexible enough ta calculate significance afterwards based on some type of segment?
Api looks super clean. No idea why I never stubled upon GrowthBook. We'll test it for sure
One of our use cases for example would be "Reduce product content text length" test, then evaluate: • sitewide significance ◦ per brand or category significance (for relevant customer) ▪︎ per product significance (for relevant customer) based on the data, without having to set up separate tests
f

fresh-football-47124

04/18/2023, 11:36 AM
ya, you can do that with one test if you want, and break the test down by a dimension
i

important-scooter-19137

04/18/2023, 11:36 AM
awesome!
f

fresh-football-47124

04/18/2023, 11:37 AM
Dimensions and segments are completely customizable
8 Views