Solved by ptrblck in post #2 
              
              
                Most likely for performance reasons. 
The input will be permuted in the forward method via: 
 # transforms X to dimensions: n_steps X batch_size X n_inputs
X = X.permute(1, 0, 2)