There is now an action called Rescan Available Python Modules and Packages that does this
https://youtrack.jetbrains.com/issue/PY-21659/Make-it-easier-to-reload-interpreter-sources-and-skeletons#focus=Comments-27-4114386.0-0