Solved by ptrblck in post #2 
              
              
                If cudnn is available (which is the case for the binaries shipping with CUDA+cudnn), it’s enabled by default and you can check it via print(torch.backends.cudnn.enabled).