I am not sure whats the expected output is, in your case.
Either way, If you want to take advantage of parallelization from F.conv2d, you just have to organize your weights accordingly (with appropriate reshape), I guess.