Okay great, you have cleared up everything. Thanks!
Just a follow-up question that is more general; I am asking because my framework is virtually failing to learn.
At some stage in the framework, inputs in a batch have different sequence lengths, I have decided to pass the inputs through a linear layer in a for loop. This means passing each element in the batch through the linear layer iteratively. Afterward, I pack the sequence to pass through an LSTM. Is there any error that comes from passing n elements in a batch with the shape (1, seq_len_i, H) during a forward pass (other than computational efficiency)?