79345591

Date: 2025-01-10 11:49:20
Score: 0.5
Natty:
Report link

Airflow polls the status of the emr serverless job every 30 secs and when its default max attempts set is reached, it errors out. You can put following configuration in emr operator in the dag to accommodate, lets say 10 hours of timeout

waiter_max_attempts=1200
waiter_delay=30
Reasons:
  • Low length (0.5):
  • Has code block (-0.5):
  • Low reputation (0.5):
Posted by: Roobal Jindal