One side effect of this issue is that while the .pfx file has been successfully imported into the Computer Certificate store with the "Mark key as exportable" checkbox ticked, whenever I try to export the certificate, the option to export the private key is grayed-out.

However, I was able to overcome the issue by doing what Yogurt The Wise suggested and do the bindings from the IIS Manager run as an Administrator