Why is the default dimensionality of GRU/LSTM layers (seq.length x batch_size x hidden_dim)? This is quite confusing, as I need to do more layer permutations, to make sure that the next layer (e.g. fc) takes in the batch rather than the sequence as an input.
What’s the rationale for this?