For anyone else observing this problem:
I had to do:
sudo ldconfig
Because apparently sometimes, the linker cache needs to be refreshed after adding new shared libraries.