In my case, I had pod running which was using the PVC. I deleted the pod and the PV / PVC which were in terminating state were automatically deleted. Ofcourse the earlier solution bt Dragomir Ivanov does work. But before that, try deleting the pod :)

Conclusion - If a user deletes a PVC in active use by a Pod, the PVC is not removed immediately. PVC removal is postponed until the PVC is no longer actively used by any Pods. Also, if an admin deletes a PV that is bound to a PVC, the PV is not removed immediately. PV removal is postponed until the PV is no longer bound to a PVC.