There is a feature request in here
https://github.com/microsoft/vscode-remote-release/issues/10421
If you want to upvote and comment.
The idea is to improve the RemoteSSH plugin to integrate with the AADSSHLogin extension functionality.