we had the same issue and discovered it in the process of hotfixing. When creating a branch from main to implement a hotfix, merge this branch with main again to deploy the hotfix. Afterwards, do not merge main with dev (in the assumption of dev-preprod-prod setup), but merge the hotfix branch with dev. In this way Azure DevOps will not include all old linked tickets again.