https://www.growthbook.io/ logo
Join Slack
Powered by
Hi Team, I am new to A/B Testing world and while ...
# give-feedback
s
Hi Team, I am new to A/B Testing world and while exploring various options, came across this great tool. I wants to run A/B testing experiments on couple of our backend applications. Application receives 10 million users requests everyday. Because of some constrains, I have to use Postgresql as data source for storing events. If someone can help me to understand if GB can handle such a large dataset for experiment results. Because of SQL Joins needs to be used to drive metrics, I am bit worried about the performance. Thanks
f
What are you using for event tracking?
ie, do you have one large event table or is it segmented at all?
s
Our applications publishes events to Kafka and from there it goes into Druid. For GB integration, I am thinking of storing events into Postgresql(by pulling existing events from Kafka)
We have multiple types of events, so I assume, I would have to create multiple tables(one for each event) to integrate with GB.
f
Growthbook pulls a list of exposed users (assignments) and then joins those users to any metric data you care about
there are ways to optimize these queries and you can also run the experiment not at full power to reduce the number of events
we have users with very very large tables, so I know it can work
👍 1
s
thanks for the quick response @fresh-football-47124
I have already checked but to double check, does GB supports Druid as data source?
f
actually I'm not sure
👍 1
looks like we may have to add support
last time I checked it didn't support enough of of the sql to work with our queries - but it seems that it might be possible now : https://github.com/growthbook/growthbook/issues/220
that was 2 years ago
s
I see.
f
if you can confirm that one of our queries to run
we can add a connector for it
s
Thanks, I will try that and confirm here.
Looks like Druid SQL is pretty much similar to SQL. It would be great we get Druid as datasource option in GB.
r
Hi Mahesh, thanks for confirming. @fresh-football-47124 What is needed on our side to add a connector for Druid?
👍 1
f
it looks like they added CTE support last year
we just need to add the connector and test it out
👍 1
42 Views
Open in Slack
PreviousNext
Powered by