The issue was that when publishing to Play Store, Google signs aab with their own certificate, therefore my certificate SHA-256 was invalid in project settings/App Check in Firebase.

After adding SHA-256 from integrity tab in Play Console to Firebase project and App Check I can test my app in closed testing.

I don't know if signing AAB by Google is default, but for me it was enabled.