If someone still facing the same issue, you have two options:

First Option:

• Write exit command before closing VSCode window.

Second option:

1. Go to File -> Preferences -> Settings
2. On "Search settings" bar write "Persistent Session Revive Process"
3. Update it from OnExit to OnExitAndWindowClose