You could try a ChainedScheduler, or, what I do is just create a full LambdaLR function myself, including warmup and then later checking for plateaus