If anyone is using Sideloadly to install the .ipa on a device: it always auto-signed my app while installing, creating a new identifier in the apple connect, which didn't have any capabilties e.g. "Sign-In with Apple".
Changing the Sidloadly settings to "Normal" install, prevented this from happening and it worked again.
