I had generated my cert with an EC key and Azure didn't like it. The file format was correct but nothing worked until I regenerated with an RSA key.