MUnique:

Am I able to use a separate 1D channel-wise convolution for that with the kernel size of 3?


I don’t understand this approach.
This would calculate the cross-correlation between (randomly initialized) filters and each channel in the activation.
I thought you would like to calculate the correlation between channel, i.e.:

corr(channel0, channel1)
corr(channel0, channel2)
…




 MUnique:

Why don’t people care about the correlation between the channels?


I’m not sure, what your actual use case is and how this would be used, so you would need to explain a bit more. Pseudo code might be helpful, too.