You can turn off Sky Reflection in your HDRP settings. You can find the settings in your project settings (or in scene volumes if added)