I faced similar problem with my Azure account 2 years ago. The trick was to use direct IP address of the server instead of the hostname and that i had to allow my network's IP address in Azure's whitelist