I faced the same issue, I'm using github-checks plugin,
If you want to disable this behavior,
Go to your you pipeline (works with multi-branch) -> Check Skip GitHub Branch Source notifications ( Under Status Checks Properties)

PS: I know this is a very late solution for your problem, but I have faced the same issue, no resource was helpful to me and this question popped up when I looked for an answer.