Update :-
https://airflow.apache.org/docs/stable/configurations-ref.html#worker-refresh-interval
Set this to higher limit and the DAG wont refresh until that time limit.