From the changelog of Python 3.13.0 beta 2, looks like tab completion has been officially added for Python REPL in Windows:

gh-111201: Add support for new pyrepl on Windows

As long as you are running Python 3.13+, completion along with other common CLI features (e.g. history, ctrl+r) will be available with the new pyrepl.