clever-hair-5481
01/08/2024, 4:29 PMcontrol
/ 10% treatment cell A (stars
) / 10% treatment cell B (satisfaction-rate
) split. The satisfaction-rate
cell was performing somewhat poorly, so we removed users from the cell and switched the test to be 70% control, 30% treatment cell A (stars
). After this change, I’m now seeing the satisfaction-rate
metrics plummeting, and many users removed due to multiple exposure errors.
What I would expect is for satisfaction-rate
metrics to remain unchanged for the rest of the test, and for stars
users not to be impacted. I’m concerned that the results won’t be valid given what I’m seeing in Growthbook. Do you think anything is messed up here / Is there anything I should change from my end to reflect what we’re expecting?fresh-football-47124
fresh-football-47124
fresh-football-47124
clever-hair-5481
01/10/2024, 10:16 PMrhythmic-agent-34208
01/12/2024, 2:08 AMrhythmic-agent-34208
01/12/2024, 2:08 AMrhythmic-agent-34208
01/12/2024, 2:14 AMclever-hair-5481
01/12/2024, 2:21 AM