Solved by albanD in post #3 
              
              
                Hi, 
I think all of these are pretty correct yes. 
Just keep in mind the distinction between autograd (that just runs the backward pass and compute gradients) and torch.nn (that is a set of utilities to work with neural nets). 


We actually build the graph under the hook. The only place where you c…