Adding
-Dspring-boot.build-image.imagePlatform=linux/arm64
to spring-boot:build-image did the trick for me.
spring-boot:build-image
See https://docs.spring.io/spring-boot/maven-plugin/build-image.html