Solved by albanD in post #2 
              
              
                Hi, 
This is “expected” given the how all these functions are supposed to work. 
In particular, load_state_dict is 100% breaking the computational graph so you won’t be able to backpropagate through what it does. 
The nn.Parameters() that are recovered by model.parameters() are supposed to be specia…