As pointed in the comments, This is something that the test runner does.

The long answer ivolves working through with NUnit and creating custom plugins for it. The simple answer is use another [Retry] package such as the Databindings.Reqnroll.NUnit.Retry