It turned out that the problem was caused by the latest versions of Surefire and Failsafe. The version 3.5.3 breaks the detection of failed scenarios somehow. Everything runs fine with version 3.5.2.
I do not know who to blame for this but let's see what the future brings.