In case anyone comes here in 2025, the solution above only works if the Databricks instance is in public mode. Will not work if you need to hide your databricks service behind a private endpoint/vnet with no public network access.