After researching, the only way I have been able to delete them is to install AWS CLI, configure it, and force a deletion with:
AWS CLI
aws s3 ls
aws s3 rb s3://BUCKET_NAME --force