Hi @tom, thanks for your quick reply. Unfortunately, it doesn’t work for me to use at:: gelu_backward_out_cuda. However, I just found that at::gelu_backward and at::_softmax_backward_data work for me. Thank you for the very important tips.
Cheers.