In my case. As I have
.config("spark.hadoop.fs.s3.impl","org.apache.hadoop.fs.s3a.S3AFileSystem")
I also have to start s3 path with "s3a:" instead of "s3"