The latest Beam (2.64.0) Python SDK added a new feature --files_to_stage (https://github.com/apache/beam/pull/34208). This will stage any files under /tmp/staged on each Dataflow worker.
--files_to_stage