It is configured in Settings > Windows.Title or in settings.json:

# Here's the default config but with rootName and activeEditorShort switched places

"window.title": "${dirty}${rootName}${separator}${activeEditorShort}${separator}${profileName}${separator}${appName}"