I want to sample feature maps in oder to select some ‘important’ channels. But this ‘sample’ operation(e.g. dropout some channels of feature maps, shown as figure below) is not differentiable and when backpropagation it will be wrong.
Which operation are you using at the moment and why is it not differentiable?