In 2025 installing the CLI in WSL side is no longer required.

The WSL option is available for example in Remote Explorer > WSL Targets.

Source: https://github.com/microsoft/vscode-docs/blob/vnext/remote-release-notes/v1_79.md#tunnels (at that time the feature was only supported in vscode.dev).