As far as I can tell, this has been a SLURM setup problem.
Only pushing to the two partitions I usually use seems to resolve the issue. My guess for now is, that the max argument list length is set to 0 for some obscure reason, due to having jobs on a specific combination of partitions have access to the same files/folders.