I was able to setup vscode Remote SSH and also avoid overloading /home by simply following these 2 steps.

1. Cleaning up the VS Code Server on the remote server using Visual Studio documentation cleaning-up-the-vs-code-server-on-the-remote.
2. Make changes to settings.json and install vscode on a seperate path other then /home following Praharsh's comment