I encountered the same error due to a simple oversight. Microsoft returns the error {"error_description":"Exception of type 'Microsoft.IdentityModel.Tokens.AudienceUriValidationFailedException' was thrown."} when the REST API is accessed using a Graph token instead of the appropriate token for the API.