Hi, Jonathan, I tried with your advice and actually I got the gradient with all zeros rather than None values. Do you have any suggestions for my problem? I don’t know why the reguster_backward_hook gives me grad_in, grad_out with all zeros.