In your rnn class in the forward function try not returning the hidden state. Then in your rnn model forward function delete the _. The problem might be that the two outputs are messing it up. If that does not work can you send your ConvNormPool code so I can try and recreate your error.