Ok, I found out that its because I used test.pypi and not the official pypi.
This helped:
pip install -i https://test.pypi.org/pypi/ --extra-index-url https://pypi.org/simple <your_package_in_testpypi>
As answered here.