Solved by ptrblck in post #4 
              
              
                You are right. Sorry for being not clear enough. 
Here is another small code example: 
old_state_dict = {}
for key in model.state_dict():
    old_state_dict[key] = model.state_dict()[key].clone()