It seems like it's not possible. I've submitted a feature request: https://issuetracker.google.com/issues/373290671.
It's unfortunate and maybe there's different API that solves this problem. I went with fetching the coordinates from Places Details (New) and using locationBias with the max radius of 50,000 meters. It's not perfect but it's better than nothing.