Could you use transformed color/fill scale? Instead of scale_color_continuous() use
continuous_scale(
aesthetics = "color",
palette = pal_seq_gradient(
low = "#132B43",
high = "#56B1F7",
"Lab"),
transform = "log"
) +
guides(color = "colorbar")