This error indicates that your Spark installation is missing the Hive and Hive-ThriftServer components, essential for starting the HiveServer2 service. This service allows remote clients to interact with a Spark SQL engine.

Try Building Spark with Hive and Hive-ThriftServer:

For Source Builds: If you're building Spark from source, you'll need to include the Hive and Hive-ThriftServer modules during the build process. Use the following command:

Bash ./build/sbt clean assembly -Phive -Phive-thriftserver