I solved the hanging issue by applying persist(MEMORY_AND_DISK) to the DataFrames retrieved from the database. It seems that the data was not being cached or was getting lost in memory, which resulted in additional queries to the database—one of which would hang. It’s unclear whether the hanging is related to the Kubernetes client eventually failing with the error 'too old resource version'. I hope this information is helpful to someone.