Hi. If I wanted to slightly modify a feature for a...
# ask-questionss
some-umbrella-45927
09/27/2023, 6:27 PMHi. If I wanted to slightly modify a feature for an ongoing experiment (control vs. variation 1), is it possible to modify variation 1, then create a new phase for the existing experiment once the modification is made?
h
helpful-application-7107
09/27/2023, 6:29 PMYes. that's possible. However, creating a new phase in an existing experiment could create problems with carry over bias, where users from phase 1 are more or less likely to return to the experiment in the control or variation buckets.
helpful-application-7107
09/27/2023, 6:31 PMYour options:
1. Restart the experiment with a new experiment key after your modification (no bias, but users may switch buckets and you throw away old data).
2. Do what you described (maybe carry over bias, users do not switch buckets, you throw away old data)
3. Make the modification and do not create a new phase (no carry over bias and no loss of old data, but the variation changing mid-experiment means your results combine two different types of features, the variation pre and post change)
s
some-umbrella-45927
09/27/2023, 6:40 PMThanks, @helpful-application-7107!
29 Views