I was able to fix this issue by running the following code in a cell in Jupyter Lab notebook itself.
pip install openpyxl --upgrade