I had a similar issue using Conv2d with PyTorch 1.1 (which I had to use due to compatibility with an old GPU), it disappeared when I used a more recent version of PyTorch.
I know this is not a very specific response, but maybe it helps anyway.