luminoussin:

the GPU-util part usually changes between 0->98->30->99 and around that


It seems that your GPUs are waiting for your CPUs. Maybe most of the time is spent loading and preprocessing data.