For those that may be interested, I wrote my own implementation that does not rely on scipy.spatial at all (although scipy.optimize is used to compute the Chebyshev center if requested), which is both faster and provides extra functionalities. However, it only supports 2D space. The module is publicly available on Github.