Finally noticed a configuration directory (.vscode-server ) on the ec2 (ubuntu) instance. I copied and renamed this directory structure, then restarted VS Code and the Markup rendering worked again in my Jupyter notebooks.
.vscode-server