@BraveEvidence
I tried to make the same project as you did - previously my plan was to make an macOS app with included C++ OpenCV. TL;DR: ended up with the exact same results as you did. Tried homebrew's version, building from source - both failed.
However I've found such a solution, which works for me: https://github.com/yeatse/opencv-spm
It it basically swift-dependency package with openCV. So far, it looks good for me.