I have check both Delete Secret - Delete Secret and related Remove-AzKeyVaultSecret, and find noway to adding the version parameters.

It seem that azure not support deleting specify version of secrets. About this topic, github has a issue discussion. you can check details here