Solved by smth in post #10 
              
              
                here’s a more precise and fuller example. What you are doing in my example is to completely avoid autograd’s automatic backward computation and manually reverse-computing the backward graph. 
For anyone  coming here with a search, my solution is a hack, it is not good practice. it is given as an ill…