Fixed by uninstalling matplotlib and installing matplotlib again in usual way, if necessary, delete files in ./miniconda3/envs/{env-name}/Lib/site-packages/

Will gladly edit if other details are found by other people or means