Why do we have to call scheduler.step() every epoch like in the tutorial by pytorch:
Observe that all parameters are being optimized
optimizer_ft = optim.SGD(model_ft.parameters(), lr=0.001, momentum=0.9)
Decay LR by a factor of 0.1 every 7 epochs
exp_lr_scheduler = lr_scheduler.StepLR(optimizer_ft, step_size=7, gamma=0.1)
https://pytorch.org/tutorials/beginner/transfer_learning_tutorial.html 421
What if we don’t call it?