Azure hosted ADO agent pools don't have access to private link Azure Databricks resources.

You need to use a self-hosted ADO agent that has connectivity to Databricks. This could be on prem over VPN to Azure, or an Azure hosted VM running the ADO agent.