I "solved" my main issue, by upgrading to Kamal 2 that does not rely on curl being available in the container image.
This does still not answer this question in particular about how to make container images with Paketo buildpacks "less optimized" by creating a less barebones image.