As @Barmar mentioned, Multiprocessing locks only work between processes in the same script. File locks can be used between unrelated processes.Suspected the same. I tried using the FileLock library, seemed to resolve the issue.