I have the same problem, I don't understand why, but it really solves the problem.

by adding one of the modifiers to the button

.accessibilityElement() or this .accessibilityAction { print("default action") }