Solved by SimonW in post #2 
              
              
                It doesn’t compute the full Jacobian. Instead, for a function y = f(x). Given some dL/dy tensor, the backward computes dL/dx, which is dL/dy * dy/dx.