Sorry for the confusion, what I mean is the GPU is not used at all when I train a neural network model using PyTorch.
From the post that you provided, my understanding is Tensorflow still uses GPU although nvidia-smi states otherwise.
For PyTorch, when I set device to “cpu”, a batch run of 10k data samples took 2 mins, but when I set device to “gpu”, the same batch run took 17 mins, although torch.cuda.is_available() is True
When I run nvidia-smi while training the neural network, it shows the GPU-Util is ~0% and GPU Memory is N/A.