I’m running into the following error:
Cudnn RNN backward can only be called in training mode
The first epoch trains fine, and the error only occurs on the 2nd epoch. I’ve made sure to call model.train() prior to generating the hidden layer inputs, calculating loss, and before loss.backward(), and model.training displays as True when I check it. If it’s useful I have to use loss.backward(retain_graph=True).
What other reasons might be causing this error? Are there other items I need to make sure I run .train() on?