Solved by ptrblck in post #2 
              
              
                You still have to call optimizer.step(). 
The scheduler will just adjust the learning rate. It won’t perform the weight updates.