79111514

Date: 2024-10-21 19:40:34
Score: 1.5
Natty:
Report link

I had an error in my app that writes to kafka

Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/spark/sql/catalyst/types/DataTypeUtils

because I was launching it using spark 3.5.1 like this

spark-submit --packages org.apache.spark:spark-sql-kafka-0-10_2.12:3.5.1 --class com.strikerft9.App od-1.0-SNAPSHOT.jar

but server had spark version 3.3.0 installed, you can check your server version using spark-submit --version

Then I simply changed 3.5.1 to 3.3.0 and it helped

Reasons:
  • No code block (0.5):
  • Low reputation (1):
Posted by: Clinical Fer