You have to separately install cudnn either by downloading it from nvidia’s site or from deb package http://developer.download.nvidia.com/compute/machine-learning/repos/ubuntu1604/x86_64/ 31 or via conda package. Cudnn is not a part of cuda toolkit. Pytorch binaries include cudnn, so when you are using pytorch binaries, you don’t have to separately install cudnn.