79340926

Date: 2025-01-08 22:41:17
Score: 2.5
Natty:
Report link

Per https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/io/FileIO.html#:~:text=the%20file%22%2C%20ex)%3B%0A%20%20%20%20%20%20%20%20%20%20%20%7D%0A%20%20%20%20%20%20%20%20%20%7D))%3B-,Writing%20files,-write()%20and FileIO writes per window/pane and it inserts a group by key for those writes.

To handle this, you will either need to insert windows which will allow the write to complete or use triggers to fire early - https://beam.apache.org/documentation/programming-guide/#triggers

Reasons:
  • Probably link only (1):
  • No code block (0.5):
  • Low reputation (1):
Posted by: Danny McCormick