Hi @ptrblck, thank you for your answer.
I’m feeding the hidden output back again to the model because the idea is use 4 words to predict the next one. For that, I pass the first word and a hidden with 0s, and then the hidden output and the next word and repeat that process 4 times. Is there a better way to do it?
The problem is, I do that process (hidden output back again) for each batch within an epoch and the problem arises when I change epochs. The only thing that I do when changing epochs is set the current_loss to 0 (for printing reasons, nothing important). I really don’t know what can be. Do you have any idea?