Oh thank you for pointing out!
But the autograd construct is generated from the modules. If I can’t trace back from grad, can I know which grad_fn is generated by specific layer module? Where to know that, in forward()? The corresponding relations between module and grad_fn bring me hard to debugging the network, plz help T_T  A lot of thanks again!