In that case, you don’t want to do the convolution itself.
You can o that trick like we do it in pytorch core here: pytorch/ConvShared.cpp at a756a9e553ad23042fa39c6452d17aba72911abb · pytorch/pytorch · GitHub 3