Wow! I have just experienced this limitation. I am implementing an WGAN with an LSTM in the generator and an LSTM in the discriminator and when I calculate the gradients I get

RuntimeError: CudnnRNNLegacyBackward is not differentiable twice

Is there any workaround? When do you think it is going to be implemented? 
Thanks a lot