It appears that caching is a big problem in pytest. I needed to run the command with --cache-clear to fix my issues. pytest test_project.py -v -s --cache-clear
--cache-clear
pytest test_project.py -v -s --cache-clear