By the way, this is how I defined the convolutions for the concatenation method. So it actually does kind of what you have suggested finally.
    self.conv0 = base_conv1d(in_channels = 1, out_channels = scaler)
    self.conv1 = base_conv1d(in_channels = in_channels * scaler,  out_channels = 512)