Solved by albanD in post #2 
              
              
                Hi, 
I think the slow part is the .cpu() here, not the .numpy(). 
Sending the Tensor to the CPU requires to sync with the GPU (if there are outstanding computations, that will be extra slow, make sure to torch.cuda.synchronize() before timing) and copy the memory to ram. 
The  numpy conversion itsel…