If you're using the MS Live Server Extension, there's a small tab on the bottom of VS Code that says: Port: 3000.

If you click on that small tab, it will bring up the Live Server menu at the top of VS Code and 4 menu items will show up. The first menu item says: Live Preview: Stop Server

If you click this first menu item, the Preview Panel will close.