With the help in this post, I finally found out that legend.key.spacing=unit(1,'cm') does exactly what I was looking for:

my_plot + guide_area() + my_plot + 
  plot_layout(guides='collect') + 
      theme(legend.key.spacing=unit(1,'cm'))