Machine Learning, Data Science, NLP, Mathematics, AI.
Vanishing Gradients in RNN The problem of vanishing gradients is very obvious in RNN. Because of the recurrence aspect, during back-propagation through time, the gradients are multiplied by the weight’s contribution to the error at each time step. The impact of this multiplication at each time step