Hey everyone I am trying to reproduce the Change %...
c
Hey everyone I am trying to reproduce the Change % measure but I am not sure about the right equation The UI shows Change % = 1.21% The related metric Configuration
ā¢ Conversion Window = 72 hours
ā¢ event count
Current Metric values that I am using ā¢ Control Group => 0.349 ā¢ Test Group => 0.353 However, When I follow the Relative equation by just using the showed values by growthbook
Change % = 100 * ((0.353-0.349)/0.349) = 1.146%
Anyway, i see some information like these which I am not sure if they influence the calculations in a way or another
Copy code
95% Credible Interval: [x%, y%]
Chance to Win: z%
risk: a%
b / user
Any help is appreciated š
r
Hi Obadah, Good morning and thank you for your response. I will now escalate this to the Data Scientist team to further investigate. As soon as we have an update, we will follow up via this thread. Thank you for your ongoing patience :)
š 1
c
Good Morning Natasha, Thank you for your quick response š
youre welcome 1
r
For the team to have all the information needed, please can you take a full screenshot of the affected results table?
Thank you, I'll relay this assisted information over to them and get back to you shortly :)
š 1
Hi Obadah, Thank you for your patience. The Data Scientist have had a look over this and have confirmed the calculation to be correct: 100 Ā­* ((2789/7898) - (3016/8644)) / (3016/8644) = 1.207991, rounded to 1.21 We can also see this another way if we just add one decimal to our rounded mean values: ā`3016/8644 = 0.3489`ā ā`2789/7898 = 0.3531`ā ā`100 Ā­* (0.3531 - 0.3489) / 0.3489 = 1.203`ā So adding one more decimal at least gets us to 1.20, and if we kept going we'd get to 1.207991! Please note, if you were to enable CUPED (which you haven't in this case, but wanted to share information incase you d in future), the exact lift % can sometimes differ from a manual calculation of the difference in means because CUPED does some magic under the hood that changes the means used in estimation (so it could actually be a little different from 0.349 and 0.353. Hope this helps to confirm the calculation for you :)
š 1
c
oh nice! I missed this in my validation, thank you so much! Thanks for sharing more info and for your help and support š
r
It was our pleasure to assist šš¼