Answer:

Simply do not trust Microsoft tools.

The manifest was indeed invalid, it's just that Microsofts CLI validator tool didn't catch one string from ShortStrings being in LongStrings even though that crashes the Add-In load.

For the "how to debug": Use the web-based Office clients where you have a console that logs everything from the getgo.