Solved by ptrblck in post #2 
              
              
                Manipulating the state_dict sounds like a valid approach, if you’ve changed some parameters (e.g. in their shape). 
On the other hand, if you’ve added or removed parameters, you could try to use load_state_dict(sd, strict=False) to ignore missing or unexpected keys.