The solution for me was to correct the "homepage": "/" in my package.json. I had been fiddling with it earlier for some github pages preview.
Soo check that as well.