As of December 2024, this is available using EKS Hybrid nodes feature. If you have a network connectivity between your on-prem and AWS, via Direct Connect or S2S VPN, you can register your on-prem nodes to an EKS cluster running on your AWS account. The installation steps can be found on the GitHub repository. Bear in mind that the pricing for hybrid nodes are based on the vCPU-hours, and details can be found here.