It was my environment issue. I had Calico CNI earlier and swapped to Cilium, but iptables still had some calico rules. I did some tweaks, restarted all the nodes and it works.