Deleting the entry in the known_hosts on the Windows client machine worked, VS Code can connect again.