I was looking at some sample code here: https://github.com/pythonnet/pythonnet/issues/623
It looks like you need to take the global interpreter lock before you call such stuff:
using (Py.GIL()) { // do the work inside here and it all works }