To completely remove all notes from the remote:

git push -d origin refs/notes/commits

Optionally, running the following afterwards will also delete them locally:

git fetch --force origin "refs/notes/*:refs/notes/*"

See @max's answer for removing them only locally, though.