I had to set workflow global env variables ARM_CLIENT_ID, ARM_CLIENT_SECRET, ARM_TENANT_ID and ARM_SUBSCRIPTION_ID, and also find a way to ingest my secrets into my workflow file. Once I had changed the service principal I was logging in with, and set the variables instead of using the azure login step, it worked.
Thanks to @VijayB for pointing me in the right direction.