So my issue was actually that my Google play API key did not match in Playfab/Unity/Play Store.
Once I fixed that I didn't have this error anymore