I want to sample feature maps in oder to select some ‘important’ channels. But this ‘sample’ operation(e.g. dropout some channels of feature maps, shown as figure below) is not differentiable and when backpropagation it will be wrong.

image1422×452 87.9 KB