Solved by ptrblck in post #4 
              
              
                Each worker will create a batch and call into your Dataset's __getitem__. 
For num_workers=0, the main thread will be used to create the batch. For num_workers=1 you will use another additional process to fetch the next batch.