My colleagues found the issue.
The 50s timeout was coming from the load balancer (Octavia) configuration. After updating it the connection got stable.
Hope it can help anybody