Solved. It really was an old and forgotten Gitlab plugin. I disabled the plugin and the icon disappeared afterwards.