This looks like it was just a version issue, which makes sense, as I was fixing my requirements file at some point, and my venv would not have reset when I rolled back.
This issue was resolved by updating the following libraries:
databricks-sql-connector==4.0.0
databricks-sqlalchemy==2.0.5
SQLAlchemy==2.0.39