To get the behavior you want, you should add a force of gravity towards the center of the asteroid when the player gets within a certain distance and have a high jump speed so that the player is able to get far enough from the asteroid. This will cause the player to be still attracted to the asteroid even if they lose contact unless they get far enough away. The force's magnitude and maximum distance can be tuned so that the player only leaves the asteroid if the player jumps.