no, you can't opening two separate file in the same window.
Each workspace file represent a complete configuration and folder set, and opening it always launches its own VS code window

However, you can opening a new folder in a new window, and switch between windows to work with multiple workspaces.