79720346

Date: 2025-07-30 17:46:32
Score: 1.5
Natty:
Report link

Using Spark UI → Stages tab

  1. Go to the Spark UI.

  2. Open the Stages tab.

  3. For each stage:

    • Look at the column “Executor CPU Time” (or sometimes called “Task Time”).

    • This shows total executor CPU time in milliseconds for all tasks in that stage.

  4. Sum these values for all stages to get total compute time of the job.

    • Alternatively, you can download the Spark event logs and script the parsing to extract CPU time per stage.
Reasons:
  • No code block (0.5):
  • Low reputation (1):
Posted by: chintan shah