I don’t know if that’s the issue, but your 0.4.0 version comes with cudnn 7.6.0, which should be faster than the cudnn version of your pytorch 1.1.0 according to this 32 link. If you use GPUs, the operations are often dispatched to cudnn ops.