I found a solution. I gave the user python read and write permissions to the /home/python/venv/lib and the pip install commands worked in the pipeline job.

@furas Thanks for the suggestions.

This is what I added to the Python Dockerfile to solve the issue:

RUN chown -R python:python /home/python/venv/lib && chmod -R u+w /home/python/venv/lib