79451686

Date: 2025-02-19 14:27:50
Score: 2
Natty:
Report link

i've had to add a couple of setting to solve the problem:

'spark.dynamicAllocation.shuffleTracking.timeout' 'spark.dynamicAllocation.cachedExecutorIdleTimeout'

once these were added, the behaviour was as expected

Reasons:
  • Low length (0.5):
  • No code block (0.5):
  • Self-answer (0.5):
  • Low reputation (0.5):
Posted by: Philipp Steiner