It looks like dotnet package search can do this now.

Here's an example from the docs:

dotnet package search Newtonsoft.Json --source https://api.nuget.org/v3/index.json --exact-match

It isn't intuitive, but it seems like the --exact-match flag is what lists all available versions.