Solved by ptrblck in post #2 
              
              
                The performance will depend on the workload you are deploying to the device. 
While small workloads will be faster on the CPU due to the kernel launch latency on the GPU, you should see a speedup for bigger sizes. 
Using this code: 
nb_iters = 100

for device in ['cpu', 'cuda']:
    for s in torch.l…