I had this issue with a Dataproc template to run a pyspark job, and solved it by removing the BigQuery.jar (spark-bigquery-latest_2.12.jar) from the "Jar files" section of the template configuration.