Data Science, Artificial Intelligence, Deep Learning, Machine Learning, Recurrent Neural Network.
vanishing gradient. If the components of the weights are large, then the gradient will grow exponentially and possibly explode NaN (not a number error). Exploding leads to an obvious crash, but the gradient is usually truncated or capped before that occurs. A vanishing gradient is harder for a