I am trying to backpropagate through a torch.heaviside function, but it seems that it disables the gradient for its output. How can I have it in a backpropagation?
If it is is non-differentiable, is there any function that produces 1,0 only?