If on a debian based OS, instead of installing opencv with pip, install it with apt
apt install python3-opencv
This solved the problem for me