When I use ‘MultiStepLR’, I also need optimizer.step() and scheduler.step(). OMG you save my time.
Really thanks.
And then… I think torch.optim.lr_scheduler.MultiStepLR 231
need to add optimized.step() also  …