You must change the ControlIdType property from "Office" to "Custom" in the Tab Properties. This will remove the 'Menu Commands' when running in "debug" or "release" mode in VS 2022.