I can also verify this since I have the same observations were using pin_memory=True and num_workers=1 I see the gpu utilization at ~40% through all the training period but with pin_memory=False and num_workers=4 the gpu utilization is at ~90%. Plus I see my cpu at full utilization since the fans kick in but without pin_memory everything seems fine.