Umar_Iqbal:

Actually for a batch_size=32, num_workers=16 seem to be quite big. Have you tried any lower number of workers? say num_workers=4 or 8.


what is the optimal num_worker for different batch_size?