Office 2016 (x32) saved the last width just fine. But Office 2021 (x64) always sets it to 200.
Thanks to rominator007's idea, I did the following:
var taskPane = wordDocument.CommandBars["Task Pane"];
if (taskPane != null && taskPane.Width < 250)
{
  // You need to first touch the Position to be able to set the Width.
  var pos = taskPane.Position;
  taskPane.Position = pos;
  taskPane.Width = 250;
}