You might experiment with a “soft” step function, such as sigmoid or x / (sqrt(x*x + delta)) * 0.5 + 0.5, where a smaller delta approximates the step function. This would yield smoother gradients and might help.
Let me know, if these approaches would work.