Solved by ptrblck in post #2 
              
              
                You can print the version with: 
print(torch.backends.cudnn.version())

The wheels come with some pre-built libraties (CUDA, cuDNN, etc.).