Hi @sungtae,
Thanks for this. What is your batch size? what size are your images? and how ‘difficult’ is your dataset and your classes?
How many num_workers are you using for the dataloader?
I’m interested as I’m getting unexpected times per epoch for large (medical) images, same batch size, iterating over ranges of num_workers with different GPUs. 1 GPU is a lot quicker per epoch than 2 GPUs???
Cheers.