This is probably happening because you selected Remote-SSH: Connect to Host... instead of Remote-SSH: Connect Current Window to Host... in the dropdown menu at the top of the window. You should use the former instead — this will keep the remote host connection in window you are currently in.