Believe it or not, I found the answer after much digging. I needed to add the following to my index.html

<base href="/">

That was it. That caused the weird behaviour.