79524921

Date: 2025-03-21 08:45:56
Score: 1
Natty:
Report link

Solved it by playing with bigquery-spark connector with session. It is really unconvenient.

if dbt.is_incremental:

    current_table = (
        session
        .read
        .format("bigquery")
        .option("table", f"{dbt.this.schema}.{dbt.this.identifier}")
        .load()
    )
Reasons:
  • Low length (0.5):
  • Has code block (-0.5):
  • Self-answer (0.5):
  • Low reputation (0.5):
Posted by: Linas