One idea is to sum the weights together (or taking their average). The reason is convolution operation has distributivity property: 
So, instead of convolving each input channel with the same filter and then adding them up, I suggest first add the channels together and then apply the convolution.