79245612

Date: 2024-12-02 21:18:19
Score: 1
Natty:
Report link

It’s tough to assist without more details, but here’s where DAB typically pulls cluster configurations from:

  1. First and foremost, check the job’s YAML file. Hope you have things sorted here.
  2. If you’re using the extension, double-check the selected cluster in the UI and the “Override Job Clusters in Bundle” checkbox.
  3. Look for cluster_id in your .databrickscfg file, in case you used Databricks CLI to configure.
  4. project.json file under .databricks folder will be holding the project level configuration for cluster.
  5. And databricks's own terraform files - .databricks/local/terraform/bundle.tf.json or terraform.tfstate - Remember, DAB is essentially a wrapper around Terraform, so these files likely hold the keys to resolving your issue.
Reasons:
  • Long answer (-0.5):
  • No code block (0.5):
  • Low reputation (1):
Posted by: Deva