I think what you are looking for is DepthWise Separable Convolution, where a 2D filter is used on 3d conv volume to avoid computation cost. And a constraint is that the number of channels(depth) of input and output will be the same. i.e. one 2D filter for every channel in the input conv volume.