Solved by albanD in post #2 
              
              
                Hi, 
You will have to disable cudnn during the rnn computation for this to work I’m afraid. 
cudnn does not support double backward. Hence the error you’re seeing.