I think this could be a case of instance error rather than issue with the retry policy itself. When the instance fails, the retry number get reset to 0. ref

"It's possible for an instance to have a failure between retry attempts. When an instance fails during a retry policy, the retry count is lost."