Is it possible to add option batch_first = True for MultiheadAttention and transformer modules like it is done for RNN ?
Batch x Sequence x Embedding
I find it more understandable and intuitive when batch is first in the input