Solved by zeakey in post #2 
              
              
                A possible solution is to split the weight parameter in a layer (e.g. nn.Conv2d) into multiple parameters, 
and then concat the outputs together. 
For example, for a layer with 2 input channels and 4 output channels, a pseudo code works as bellow: 
class MyConv(nn.Module):

    def __init__(self, ch…