Solved by eqy in post #3 
              
              
                This sounds like a grouped convolution with the number of groups == number of input channels Conv2d — PyTorch 1.9.0 documentation, but I’m not sure because the current code example doesn’t run. Could you post a runnable code snippet to help confirm? The indexing of the filters by batch also seems ve…