It looks like they've added support for this issue in Powershell now.

register-python-argcomplete --shell powershell my-awesome-script | Out-String | Invoke-Expression

Reference: https://github.com/kislyuk/argcomplete/tree/main/contrib