I encountered the same issue when I was experimenting with privatelink.vaultcore.azure.net linking and unlinking a VNet that was peered with the KV. For me, it was transient, which resolved after the VNet link was established.