Solved by albanD in post #2 
              
              
                Hi, 
This might be because the autograd is not running, so the the CPU has less work to do and can send work to the GPU faster?