Thank you so much for your rely. I check my gpu-util, it’s jumping between 0% and 100% which I think means I’m not feeding the data to gpu fast enough. Also, I check the cpu usage, it’s around 55% when num_workers=8. So HDD is the bottleneck of training speed? Or can I optimize it through code?
Really appreciate your help！