Solved by ptrblck in post #8 
              
              
                You should get an error, if you try to push tensors or the model to the GPU and no GPU is available. 
Also, once the data is transferred, you can check the device via print(X_test.device) and make sure it’s cuda:id. 
Your GPU utilization might be that low as your model is really small, such that you…