coord_cartesian() will plot values even if they are close or outside of your defined limits.
coord_cartesian()
p + geom_pointrange(aes(ymin = lower, ymax = upper)) + coord_cartesian(ylim=c(NA, 5.2))