Hi all, I’m posting here because I was also getting a RuntimeError: CUDNN_STATUS_EXECUTION_FAILED, also with an LSTM model, but for a different cause…
In my case, my issue was resolved by reducing the length of my truncated backpropagation length in my LSTM training.
If I had to guess, I think I’m running out of GPU memory when it hits the LSTM call.  If I set the truncated backpropagation length even higher, then I get a more interpretable CUDA out of memory error, since I think it runs out of memory before it hits the RNN.
Hopefully this helps somebody out.  Would be interested if somebody could confirm my hypothesis or explain what’s actually happening.