I guess this is some kind of a hiccup that goes away by itself.
When I've disconnected from WSL and connected again, the plugin appeared in the "WSL:UBUNTU" plugin list.