How are you checking if the GPU is used for computation? To validate its usage you could check the util. in nvidia-smi or check the used CUDA kernels in a profiler. In general, if the model, input and output data are all on the GPU, the computation will also be performed on the GPU as PyTorch won’t move data to the CPU without explicit to() calls.