For anyone wondering, the issue was with my package.json file, I was running my build as vite build but the correct version was remix vite:build.
So change "build": "vite build && vite build --ssr" to
"build": "remix vite:build",
There isn't really an error that shows up to display this, it just never completes after displaying ✓ built in 3.25s.