I have the same problem, but it happens with all media playback, including YouTube, smart audio book player and audible. The only solutio is to reboot the phone. It may be a hardware issue (pixel six pro) as sometimes I have to power off.