It seems that you can stop prefetch by adding hooks in nuxt.config.ts

https://github.com/nuxt/nuxt/issues/13778#issuecomment-2076656036

hooks: {
    "build:manifest": (manifest) => {
        for (const key in manifest) {
            const file = manifest[key];
            //all file stop prefetch；
            file.preload = false;
            file.prefetch = false;
        }
    },
},