Hi,
Actually, I prefer to link a blog that explained this idea very interesting rather than explaining myself as it will be based on this.

  
      
      Paperspace Blog – 29 May 19
  
  
    

PyTorch Basics: Understanding Autograd and Computation Graphs 782

In this article, we dive into how PyTorch's Autograd engine performs automatic differentiation.


  
  
    
    
  
  


Bests