The proxy_pass
approach is correct, but please consider private connection between your EC2 instance and S3 bucket, so the content can be available only through established tunnel in AWS VPC network. Not doing that will result in bad things as:
The full answer on how to achieve that you can find in my response on similar question here :)