I had exactly the same problem and the issue was not the ingress nginx. In my scenario, the traffic first routes to an external load balancer (haproxy) and then the load balancer sends the traffic to the Nginx ingress. In fact the haproxy was adding 80 port in the header. So I added this to my haproxy frontend section:

acl ACL_stage-app hdr(host) -i stage-app.mydomain.ir www.stage-app.mydomain.ir

http-request set-header X-Forwarded-Port 443 if ACL_stage-app