Hi, in the post you mentioned, I found that Pytorch lstm initializes hidden states to zeros if I don’t provide them as arguments, so that means I don’t necessarily have to initialize them after each batch. In @sgaur’s case, he/she is not providing the hidden states as arguments so I guess there’s no need to initialize/detach them each batch.