Hi Chris, good find!
The docs make it seem like the re-randomization selection should be available when creating a new phase, but it's actually shown in the "Edit targeting" modal.
We are going to add it to the new phase modal as well, now that you've pointed it out.