Solved by ptrblck in post #2 
              
              
                Hi Francois, 
Autograd will track all operations in the forward pass in a computation graph and use it in the backward pass to calculate the gradients for all parameters. 
You can pass the output of one module/model to another one. As long as you don’t detach the activations e.g. via tensor = tensor…