For me The issue was that I had only uploaded the production APNs Auth Key.
For development builds, you also need to upload the Development APNs Auth Key (.p8) from Apple Developer (sandbox key) into Firebase. Once I uploaded that as well, push notifications started working. That was the missing piece.
Get your keys from :
https://developer.apple.com/account/resources/authkeys/add