I need to create an ADF pipeline to restart a databricks cluster. I am trying to do this using web activity by using token authentication. Token is saved in keyvault but how to fetch the token from keyvault and pass it in web activity without exposing the secret in pipeline run logs.
Make sure your ADF instance has permission to access your Key Vault. You can do this by assigning the appropriate role using either RBAC (IAM) or by adding an Access Policy directly in the Key Vault settings to allow Get permission on secrets.
This allows you to securely pass the token into headers or bodies of subsequent Web activities by using dynamic content. "@activity('Web1').output.value"
Make sure to turn on Secure Inputs and Secure Outputs for any activities dealing with the secret. This ensures that the token doesn’t show up in pipeline run history or logs, protecting it from being viewed by unauthorized users.
Also you can refer SO