Solved by ptrblck in post #2 
              
              
                It should be sufficient to move your tensors to the GPU. 
You can check the current device by printing tensor.device. 
If your GPU is not fully utilized your code might have some bottleneck or the operations are just too small so that the overhead of moving between host and device is bigger than the…