79355546

Date: 2025-01-14 15:51:03
Score: 2.5
Natty:
Report link

spark3-submit --properties-file ${CONFIG_DIR}/${PROCESS_NM}.conf --queue ${YARN_POOL_NAME} --master yarn --deploy-mode cluster --num-executors 20 --executor-cores 4 --driver-memory 60g --executor-memory 8g --conf spark.sql.shuffle.partitions=400 --conf spark.yarn.executor.memoryOverhead=8192 /apps/edh/prod/adhocjobs/data/rubin/${PROCESS_NM}.py > ${LOG_DIR}/${PROCESS_NM}_${LOG_FILE_TS}.log

Reasons:
  • No code block (0.5):
  • Self-answer (0.5):
  • Single line (0.5):
  • Low reputation (1):
Posted by: Rubin Baghel