How should this layer work for 3 input images?
I.e. do you want to apply a nn.Conv3d layer and treat the multiple images as the depth dimension or apply an nn.Conv2d layer for each image?
In the latter case, how would the output be defined?