While the performance might increase in trade of more memory usage on the GPU, I wouldn’t argue that batching is completely “useless”, as @witl would lose all random transformations.
Iteration the dataset once, will apply the transformations (if used) once for each sample and store move it to the GPU.
Of course it depends on the use case, if a performance (accuracy) drop would be seen, but this should be kept in mind when using this “static” approach.