Solved by smth in post #4 
              
              
                I took you down the wrong rabbit-hole and its ENTIRELY my fault, sorry about that. 
We do have functions in C+±land whose derivatives are entirely defined by tracing, but this is not such a function. 
inverse's derivate is speficied in derivatives.yaml here: https://github.com/pytorch/pytorch/blob/e…