What I did was:

xed ios

Then build using xcode. After that it seems to work going pack to normal builds using

npx expo run:ios --device

Not sure why building in normal xcode fixes this but it works