NAT gate way is only to provide internet access to the private instance through private subnet unlike public subnet has Internet gateway. if you want to access anything through private you must have a NAT gateway in private subnet. NAT gateway deployed in public only to provide NAT gate way to access internet.