79578360

Date: 2025-04-17 02:22:09
Score: 2
Natty:
Report link

in case you still have this problem, I think a good workaround is to only return one of these two optimizers with your configure_optimizers method. The other one you can write into a field of your lightning module. This way only one of them will be wrapped as Lightningoptimizer (and thereby contribute towards global_step). I think this does not have any side effects except that now the optimizer states of only the optimizer that you returned with configure_optimizers are serialized together with your model checkpoints.

Best,

Chris

Reasons:
  • Contains signature (1):
  • Long answer (-0.5):
  • No code block (0.5):
  • Low reputation (1):
Posted by: Chris