Thanks to ElpieKay for their comment on this post that pointed me in the right direction.
For tags, git ls-remote [--branches] [--tags] <repository> (piping it to awk '{print $2}' did a good job of getting rid of the object names too).
git ls-remote [--branches] [--tags] <repository>
awk '{print $2}'