Thanks @user_123454321. I followed these steps in this video listed below and now my GPU is getting utilized well.Install TensorFlow GPU and PyTorch with CUDA on Windows 10 Anaconda | CUDA 10.1 cuDNN 7.6