Thanks a lot for the detailed reply!!
In 3, I am still a bit confused as to why I need to separately maintain the hidden tensor. Isn’t the LSTM module supposed to do that, since it takes seq_length as an input (the 3d tensor: seq_len, batch_size, feature_size)?
So, in what use case (I suspect a single LSTM cell) should a lstm be passed a hidden variable? Is it the same LSTM as nn.Module’s or a different api?
Also, in 6, say, I have a large tensor for my entire input, how do I construct batches from that input, does Pytorch have any apis to do that?
Cheers!