What you're looking for is to disable "local auth" to the AOAI instance. Docs can be found here: https://learn.microsoft.com/en-us/azure/ai-services/disable-local-auth#how-to-disable-local-authentication