Make sure you preserve client IP address:
https://docs.konghq.com/kubernetes-ingress-controller/latest/guides/security/client-ip/
Cloudfront and Firewalls on the way to gateway may replace Host IP with their own and pass client IP in another header like X-Forwarded-For, you should configure your Kong to copy real IP.