Solved by Diego999 in post #2 
              
              
                I realized the problem is not from torch.split, but rather from the CUDA code for RNN. I’m saying this because I did the operation on CPU using numpy and converted to a tensor of Xx2 I give during the forward pass and it still doesn’t work. 
I downgraded to cuda 9.0, cudnn 7.0 and last release of py…