How about google ceres, I use it to replace my scipy "l_bfgs_b", it is fine.
But my prolem is pretty simple, not sure about complicated problems.