Make sure you use sqlalchemy >= 2.0.0
I was using sqlalchemy 1.4.28 with the latest pandas, which are no longer compatible (and could not upgrade because my airflow version was limited to sqlalchemy < 2.0.0)
See this discussion: https://github.com/pandas-dev/pandas/issues/58949#issuecomment-2153485545