Hi. Thank you for the response.



 SageAgastya:

Firstly I would suggest you to squeeze in the inner dimension of input and cast it into a shape of (batch_size, seq_len) as you want to use batch_first in your model.


So my input is of shape (3, 1, 9) = (batch_size, 1, seq_len), are you saying that I should reshape it to just (3, 9) i.e (batch_size, seq_len)?



 SageAgastya:

So either use the output of last hidden state (or pool the output of all the hidden states) to get a vector of shape (batch_size, 2*hidden_dim).


Could you explain this part. I didn’t really understand this.
Thanks