79084809

Date: 2024-10-14 05:34:53
Score: 0.5
Natty:
Report link

I think it's more common to have required dependencies in the zip file, then you can have the main python file outside the zip and call it like so

spark-submit --deploy-mode cluster --master yarn --py-files s3://my-dev/scripts/job-launchers/dev/pipeline.zip s3://my-dev/scripts/job-launchers/dev/job.py
Reasons:
  • Low length (0.5):
  • Has code block (-0.5):
  • Low reputation (0.5):
Posted by: Gin