I recently came across the same issue and found a solution.

Using the authV2 extension for az cli the following command works:

az webapp auth update --resource-group RESOURCE --name APP --set 'identityProviders.azureStaticWebApps.registration={}'