Been dealing with a similar problem where where I work, we have a mono-repo consisting of many services with separate venvs and working on a feature across multiple services is pretty common.

Found this extension for visual studio very useful:
https://marketplace.visualstudio.com/items?itemName=teticio.python-envy

It automatically detects interpreters and activates them according to the file you're on.