A slightly easier to read/condensed version of earlier replies:
To set a default language in Visual Studio Code:
Open settings with CTRL + ,
Search for "default language"
Type "html" or "powershell" or whatever language you want.
Visual Studio Code will then add the line ""files.defaultLanguage": "YourSelectedLanguage"" to your settings.json file.