For anyone else going down this rabbit hole, completely removing Anaconda (miniconda3 in my case) from the environment fixed my exit hang problems.

I'm assuming I messed up when using conda.