Ok, after literally days of support by a Microsoft partner, we came to a solution. We installed a NAT Gateway and this finally resulted in a much more stable connection without the intermittent errors. For more information on this system have a look at the documentation here Azure NAT Gateway