Well, the method installing nomkl then numpy didn't work for me. Also because I could not install other libraries like ortools using that method.

Instead, I made sure I was only importing the essentials submodules (from numpy import array, interp, ...) instead of importing the entire numpy library, and this did significantly reduce the size (44 MB instead of 250)