I ended up running npx expo-doctor@latest and that revealed some issues related to metro resolutions and overrides. I fixed them and was able to build without any more errors
npx expo-doctor@latest