Yes, I used pin_memory=True and all 8x GA100s on this node. Also I loaded and augmented the ImageNet data on-the-fly.
The difference would be that I’ve used DistributedDataParallel with a single process per GPU, while you are using nn.DataParallel, which might cause a different CPU usage (unsure, as I haven’t verified it).
Could you try to use DDP and check, if the usage is still the same (or remove DataParallel)?