Solved by ptrblck in post #2 
              
              
                In the first use case the middle_linear layer will be used a few times with the same weights, since its output is fed into the layer again. 
In the second example, the extra_layer will be registered as a parameter in the model but won’t be updated, since the forward method doesn’t use it. You can ha…