The issue looks like it's coming from the space(s) in your paths. Specifically your user (Gagana H). I would recommend reinstalling python to C:\python
and changing your PYSPARK_DRIVER_PYTHON
, PYSPARK_PYTHON
, and PYTHON_PATH
environment variables to point to the new install location.