This is 5 years late and I obviously I don't have your data so can't reproduce and test exactly, but having just dealt with a similar problem, I would suggest that you need to add "plot.background = element_blank()" to your theme() layer, rather than "panel.background". I tried "plot.background = element_rect(fill='transparent')" but that didn't work and neither did playing with "panel.border".