In case anyone finds this in 2024, enabling public internet access on the SageMaker domain fixed this issue for me.