The batch size has the same meaning as in the traditional feed forward models.
It stands for the number of sequences you want to process at the same time.
So your input should be of size (sequence_length, batch_size, number_of_features).