Deep Learning, Python, Data Science, Programming, Neural Networks.
weights and biases of the neurons are updated in such a way that the ReLU neurons consistently output negative values for all inputs during training. As a result, the gradients of these neurons become zero (or close to zero) during backpropagation and it causes the weights linked to these neurons