Solved: There is setting in pipeline defination *force_rerun which is by default False. Changing that setting to True solved the issue of rerun.
app_pipeline.settings.force_rerun = True
force_rerun (boolean): Whether to force rerun the whole pipeline. The default value is False. This means that by default, the pipeline tries to reuse the output of the previous job if it meets reuse criteria. If set as True, all steps in the pipeline will rerun.