Initially, I started optimizer at LR=2e-4, and StepLR scheduler with decay of 0.1 every 50 epochs.
Now after 50 epochs, I think my LR is too high, and I want the optimizer to go to (1e-4 x 0.1) instead of (2e-4 x 0.1).
So if I change the param_groups['lr'] in the optimizer, and the scheduler.base_lrs correctly, I should be fine? I’m using Adam, and I know momentum variables might need to be handled, but otherwise, is this sufficient? (And if someone could guide me on how to adjust momentum here. I think my only choice is to reset momentum and allow the optimizer to recompute it…)