For some reason, having only a component in AllSkill was causing an issue. If I try to set up an other "fixed" field, like name like this:

ANd then in the content manager, I have to edit the view for MySkill, like this, so it doesn't show the id, but rather the name:

And that is it, now I am able to choose multiple skills in MySkill, that are related to AllSkill