Hey Team, I'm currently running an experiment with...
# experimentation
a
Hey Team, I'm currently running an experiment with 2 metrics. One created using the Legacy Query with Denominator and one ratio using the Fact Tables. For the Fact Table one it displays the
main_sum
but shouldn't it display the
main_denominator_sum_product
comparing with Legacy Query one?
h
Hey Cyril! The Fact Table Ratio Metric should definitely have
main_denominator_sum_product
a
I want to switch to use the Fact Tables, but I’ll wait a bit until this is fixed. Thanks.
Is it something that was reported already? Do you need more info?
h
The first screen shot could be from a legacy metric if the denominator is
binomial
.
a
yes it is
h
Are you sure the first one is from a Ratio Fact metric? Can you share some part of the SQL, or the tooltip you see when you hover over the metric name in the results table?
a
the second one
First one => legacy binomial Second => Fact Tables ratio
int the Fact Tables results I see the same result in
main_denominator_sum_product
than the Lagacy one
main_sum
But on display and calculation it uses the main_sum for both
h
So for legacy metrics with a binomial denominator, we actually treat these as more like a funnel metric.
So in that case it will filter the user count but it won't show up as the
denominator
fields in the SQL.
a
so there is no way of generating the same data with Fact Tables?
h
I think if you use the denominator filters also in the numerator the metric values will be the same.
But yes, easy to use funnel metrics are the biggest remaining gap between legacy and fact metrics
I just tested myself; I'm able to get very close to the Legacy Metric with Binomial denominator using a Fact Table Ratio Metric, where I put the denominator filters in the numerator as well. The metric values in the numerator and denominator are identical (see first image, with slight formatting differences) The statistical results are very similar, but differ a tiny amount. Both of the above are my expectation based on our current feature set. --- So, it is true that the exact functionality is not replicable in Ratio Metrics right now, and we hope to close that gap at some point. However, you can get very close with a bit of work defining your Fact Metric.
a
For the Fact Table metric, I see the same result in
main_denominator_sum_product
than in
main_sum
of the Legacy Funnel
so it seems it’s working properly
therefore on the display
so it might just be that the wrong value is displayed on the UI?
h
Right, but the numerator comes from
main_sum
. You can make
main_sum
18 if you use the filters you're using in your denominator in your numerator.
a
ha ok, going to try that
thanks
h
Sorry, I know this is unnecessarily complicated. We hope to make this easier in the near future!
a
sure, the experiment I run is a bit complex, so for now I’ll stick to Legacy Funnel 🙂
thanks for the explanation
1