Unfortunately, you can't change the response headers for files served by Google Drive. This means you won't be able to adjust the Content-Type or CORS settings to suit your needs.
things you can try out :
Host Elsewhere (Amazon S3, Google Cloud Storage, or a dedicated audio hosting service)