Didn't find an answer to this, but worked around it by making a pymysql session instead that I was able to close when needed.