I believe you can just delete the new phase (top-right drop down menu). You'd need to temporarily set the experiment to draft to do this, and then start it again once the phase is removed. Once it's started again, you may need to edit the current phase to remove the end date.