This is a problem associated with the MIME type/content-type of the files, here's what you can do to fix this:
1. If you are uploading files to the bucket using AWS CLI, use official and latest version, let the utility guess the mime types of the files. Invalidate all files in cloudfront after this.
2. Clear you browsers cache & cookies. Issue should be fixed!!