So i just used packer to bake my own images for GCE and ran into the following situation.
Installed CUDA 9.0 and everything worked fine, I could train my models on the GPU.
Afte a while I noticed I forgot to install cuDNN, however it seems that pytorch does not complain about this. On an image with only CUDA installed, if I run
torch.backends.cudnn.version() I get 7102 and torch.backends.cudnn.enabled == True
When I did install cuDNN from https://developer.nvidia.com/cudnn 212, everything still worked fine, I still got the same outputs for the two command above, but I didn’t get significant speedups.
Does this mean if one installs only CUDA and PyTorch, cuDNN also gets magically installed? Or is there a way how to check if pytorch is really using the speedups promised from cuDNN?
Any advice? Thanks