ax.figure.draw_without_rendering()
The top answer is a good solution. You can use this function before getting the offsettext instead of tight_layout(). I would also use \times instead of x. (Sry new user, so not enough rep to comment.)