Hello all, I have a network architecture as follows:

input --> conv1 (3,1,1) --> bn --> relu --> conv2 (3,1,1)
                  |                               ^
                  |-------------------------------|

where conv1(3,1,1) means kernel size is 3, stride 1 and padding 1
The output of conv1 will be concatenate with the output of conv2. It is easy to using torch.cat function to concatenate them. However, I am using the function self.add_module to write the network. How could I use concatenation function on the case? This is my sample code
self.add_module('conv1', nn.Conv3d(32, 64, kernel_size=3, stride=1))
self.add_module('conv1_norm', nn.BatchNorm3d(64))
self.add_module('conv1_relu', nn.ReLU(inplace=True))
self.add_module('conv2', nn.Conv3d(64, 128, kernel_size=3, stride=1))
# Concatenate ???

Thanks