Thanks for the example. So from my understanding, there is no way to manipulate the tensors that are required in the backward pass? And also creating a new tensor would detach it from the computation graph?
Is this also the case if I set retain_graph = True?