It was the dumbest problem I've ever encountered!

In my project path, one of the directories had a "!" in the name and that was the reason it couldn't get to the META-INF directory! Once I moved it to a different location it worked.

The error log suggesting that it had something to do with the plugin version was really not helpful and I also created an issue here, hopefully it will be fixed.