@ptrblck Apart from everything, the training goes very smooth (as expected) on the following GPUs (Single GPU training):


GeForce RTX 2080 (16 CPU cores)

Titan XP                   (48 CPU cores)

In these cases, the CPU usage does not go to 100%.
But it stucks on:


Tesla T4 (96 CPU cores)

Titan RTX (96 CPU cores)

In these cases, the CPU usage go to 100% for 2-3 cores and the rest are at bare minimum.
So i think its not a problem of DataLoader.