This message was deleted.

I'm running 2 more A/A experiments with a similar setup to validate as well but so far I've seen the same behavior, I wonder if maybe I should run this in just one landing page

Perhaps run some that only have 1 variation, and for 4 weeks - so it gets more power. 5k users per experience sounds on the low side. a rule of thumb is to use 1k+ conversions per experience. (Though some claim 400 or 500 may be OK) And sounds wise to run 5+ A/A tests, so you don't just see 1 outlier

good point Chris, alright I'll add a couple of A/A tests with just 1 variation and be more patient, thank you!