Turns out the libraries are different depending on whether you are building libunwind from the LLVM project repository or from the other distribution.

CLang searches for the version that links with libunwind.so.1 (the one that comes with the LLVM project), while the ladder produces libunwind.so.8, which I am not sure is even compatible with clang.