I was banging my head against a wall with this as well but as it turns out, VS Code will fail to install on the remote machine if tar is not present on the remote machine. Make sure tar is installed and try again, because the installation script that it runs seems to take advantage of that program.