Solved by tom in post #2 
              
              
                If you look at the details in the documentation (and know where to look), you see that each batch is compiled by a single worker (it runs the collate function that makes batches from lists of examples). 
With this, you have two options to get “batch-level” processing: 

Have the dataset build and re…