Thanks for the comments!
Also, I have to mention that the batches are sampled randomly. So In side the batch the data is sequential. But the next batch does not contains the next data points.
Does this make a difference?