It works to set reset=True
self.sheet.set_row_heights(26, reset=True)
Other solutions like refreshing the sheet (self.sheet.refresh()) doesn't work for me.