Hi! I have a question about CUPED. When the toggle is On, analysis is re-runned, I see bad guardrail trend warning, but in fact the value of variation 1 is higher than the baseline value. Why does this happen?
f
fresh-football-47124
05/21/2024, 3:22 PM
@helpful-application-7107 thoughts?
h
helpful-application-7107
05/21/2024, 5:03 PM
We return the raw baseline and variation in the table. However, with CUPED, we actually used adjusted baselines and variations to reduce variance, so what we use to compute the % Change is different from those exact values.