Yes, that should be possible. Just removing the relation from the items.xml should work. Since it is a many2many relation, it you also should clean up the relation from the type system.