So after posting this I realized what the issue is. The visual editor of course need the chrome extension which is not available in production and therefore the debug panel shows a bunch of errors. However when I started the experiment it worked.
I'll leave this post here if anyone in the future encounters the same misunderstanding.