I found the problem. The thing is that when adding angle, geom_image seems to be adding some blank square around the image. The solution is to remove the background through the argument image_fun :)

geom_image(
    aes(
      image = image, 
      angle = orientation_degree
      ), 
    image_fun = \(img) {
      img %>%
        magick::image_background('none')
    }
  )