Hi team! :wave:
Thanks again for the event, it was...
# ask-questionss
sparse-needle-41578
04/11/2024, 6:01 PMHi team! 👋
Thanks again for the event, it was great to see the updates!
Apart from the Multiple Exposures Warning, we've been noticing that the results are not accurate for some reason. I created an experiment that doesn't change anything on the site, so both variations should show similar results, but what happened is that one variation is performing a lot better than the other. Maybe this is related to what causes the Multiple Exposures warning 🤔
I'm sharing in this thread the code that we have for the Hybrid SSR integration, I really appreciate the help
sparse-needle-41578
04/11/2024, 6:05 PMThis is a Remix app, and the code below is added to the root route (app/root.tsx)
f
fresh-football-47124
04/12/2024, 7:42 AM
HI Matheus - your conversion numbers are still quite small, even if the denominator is large
fresh-football-47124
04/12/2024, 7:44 AM
its not uncommon for experimentation platforms to set a 200 conversion event limit before even showing results. You have 70 vs 93 and 44 vs 66 - which is not unreasonable that this is just natural variance or skewed by a few outliers (you can add percentile capping or winsorization to help see)
fresh-football-47124
04/12/2024, 7:44 AM
I believe by default we use 150
s
sparse-needle-41578
04/12/2024, 8:10 PMThat makes sense, thank you so much for looking into it! I changed the limit back to 150 and I'll keep the experiment running
13 Views