You can hide access to the organisation settings by adding users to the Project-Scoped-User group. Needs to be enabled as a preview feature. See the section "Restrict user visibility to organization and project information" at the following link

https://learn.microsoft.com/en-us/azure/devops/organizations/accounts/add-organization-users?view=azure-devops&tabs=browser