A possible workaround I found:
If instead of CTRL+F, I use CTRL+SHIFT+F, to get the full search window, I get the option to uncheck "Include miscellaneous files":
This has the effect of returning only source code results instead of the "SourceServer" duplicates.
No such option exists for quick find.