By using viewsContainers, views and registerWebviewViewProvider you could add the UI on the primary sidebar beside the extensions .

You can checkout this repo : https://github.com/ScriptSanctum/vs-code-primary-sidebar

where I have added button on the primary sidebar using CalicoColors from samples.