I was able to get Vmmem to finally stop. No restart.
I had to disable Hyper V Host Compute Service from services, not just stop it.
enter image description here
I was then able to flip it back to manual and Vmmem stayed closed, without restarting.
Reasons:
Blacklisted phrase (1): enter image description here