Hi @ptrblck, sorry for the late response. It’s a simple imread of PNG files in __getitem__. I use the default collate function which PyTorch provides. An alternative explanation could be that the file IO speed is low as opposed to processor but I’m guessing PyTorch would have locking mechanisms to handle such situations.
It also seems the master GPU, default device:0 has higher memory requirements because it is used to perform backprop(?). Would you advice a system with, say 8GB GPUsX9 and the 10th one as 16 GB. That way we can maximize the use across the rest of the GPUs. Any advice would be greatly appreciated!