Hi, @apaszke, I have tried the code and I got:
In [1]: import torch

In [2]: print(torch.backends.cudnn.is_acceptable(torch.cuda.FloatTensor(1)))
   ...: print(torch.backends.cudnn.version())
   ...:
True
5005

Now the error code change to:
torch.backends.cudnn.CuDNNError: 6: CUDNN_STATUS_ARCH_MISMATCH
Exception ctypes.ArgumentError: "argument 1: <type 'exceptions.TypeError'>: Don't know how to convert parameter 1" in <bound method CuDNNHandle.__del__ of <torch.backends.cudnn.CuDNNHandle instance at 0x7f4b9099a320>> ignored

I just found that my gpu is Tesla M2075, I searched a similar issue in caffe, saying that cudnn require higher version than pure cuda. Is it not supported in Tesla? Can I run the sample code with only cuda instead of cudnn?