I also faced the same challenge on Windows, pip and conda were giving me endless challenges and compatibility issues. I then used Anaconda Navigator, selected the environment, searched for matplotlib and pressed apply.
I then opened my environment in Jupyter Notebook and I was able to use the module.
Let me know how that goes.