The answer was to add a .contentShape() with the shape of my choice to the image View for it to not overflow and allowing me to still access the scrollView.