Solved by Dwight_Foster in post #2 
              
              
                Yes this is correct. batch_first just decides whether the batch should come first in the shape of the output or not. If you set it to True the batch size will be the first dimension. If false the batch_size will be the second dimension.