@RayJ See my comment in the issue tracker on github: https://github.com/pytorch/pytorch/issues/4884 272
Probably at some point in your network, the feature maps get smaller than the kernel size you want to apply. Providing a larger input image or adapting the architecture will likely fix the issue.