Solved by ptrblck in post #2 
              
              
                This seems to be related to this issue. 
If you print the optimizer’s learning rate, you should see that it’s behaving as expected: 
model = nn.Linear(1, 1) # 'Net' is a simple MLP
optimizer = torch.optim.SGD(model.parameters(), lr=1e-2)
schedular = torch.optim.lr_scheduler.StepLR(optimizer, step_si…