I created a new demo tenant and opened a support ticket from new demo tenant. The Azure support informed me that payment method cannot be deleted if subscription is orphaned. So they deleted the details from backend