Solved by ptrblck in post #2 
              
              
                I assume the learning rate was stored in the state_dict and thus loaded in: 
opt.load_state_dict(torch.load(load_saved)['optimizer']

which I would consider the correct behavior to restore the previous session. 
If you want to change it after loading the state_dict, you could change it directly in t…