Here is a colab link with the output for 2 tests at the bottom. One test is the normal way of running, and the second is with the implicit tensor calculation. As you can see, the gradients aren’t being tracked in the 2nd test.

  
      

      colab.research.google.com
  

  
    

Google Colaboratory