Why don't you just exclude vscode/settings.json file from .gitignore and add it to the git repository?

There's nothing wrong in sharing your configuration among your teammates if that's what you have agreed upon.

As for more granular approach, unfortunately it's not currently possible. There is opened issue for this in vscode git repo which would allow to extend config from some basic configuration (which would make it possible to share only part of config and not file as a whole), but it had not progressed for several years, so I guess it's not a high priority issue.