Since Kubernetes v1.33, the tolerance can be adjusted per HPA: https://kubernetes.io/blog/2025/04/28/kubernetes-v1-33-hpa-configurable-tolerance/
It's an alpha feature, scheduled for graduation to beta in v1.34.