Solved by ptrblck in post #2 
              
              
                Basically you are right. The “missing” operations won’t be tracked by Autograd and thus the backward pass won’t be performed on them either. 
However, these layers are still registered as parameters to the model, so they will show up in the print statement as well as in model.parameters(). 
Since t…