Solved by tom in post #2 
              
              
                They map to C++ code in ATen/native/RNN.cpp, the same in the cudnn subdirectory  or native cuda kernels in the cuda subdirectory’s RNN.cu. 
You can see by following the same method as described in my Selective excursion into PyTorch internals blog post, with a little detour at the beginning from tor…