Apparently you have to drag a source code file from the solution explorer to a diagram. If the file contains multiple classes, all will be added.

If I only want to add one class, I have to remove all others manually from the diagram after adding the whole file.