I don't really know what's going on, but I did use the ParaglideJS Component that came preinstalled with a fresh SvelteKit installation. When I commented it out in my root +layout.svelte, it magically worked.
+layout.svelte