Solved by albanD in post #2 
              
              
                Hi, 
The problem is that when you get the state dict, it does not clone all the Tensors but gives you reference to them. 
So when further training updates your model, it also updates the values stored in your checkpoint. 
You can do: checkpoint['state'] = {name: t.clone() for name, t in model.state_…