I got the same issue, and as Brett said, the solution for me was to use the Certificate. It seems like an issue from SharePoint. It is not normal that it refuses to authorize with client secret.