I’m not familiar enough with Windows, so don’t know what each metric shown by the task manager means.
The Cuda window should show the compute utilization, which would show the GPU util. when PyTorch uses the device for computations.
Alternatively, use nvidia-smi, which would show the same.