I tried PyTorch 0.4.1, Nvidia Quadro P5000 Driver R396 U2 (397.93), with cuda 9.2.
torch.cuda.is_available()
is True
But I still face the problem of N/A for both GPU utilisation and memory allocation. Does this mean PyTorch cuda  is not supported in Windows?