Your explanation sounds right and fits into the standard conv approach shown in the attached picture.



 hamedB:

and what I need is the activations for each filter with shape [4,24,24] instead of [1,24,24].


My code snippet provides exactly this with additionally the channel dim reduction to verify that the outputs are equal.