The problem ended up being that I was not using the ARM version of conda, which was necessary for my M1 mac. I ended deleting Anaconda, installing the ARM version of Miniconda, then rebuilding the environment. For the TensorFlow install, I used pip install tensorflow-macos and pip install tensorflow-metal to get the correct versions.