Machine Learning, Neural Network Algorithm, Differential Equations.
backpropagation algorithm. To calculate how the loss function depends on the weights in the network, we repeatedly apply the chain rule on our intermediate gradients, multiplying them along the way. These multiplications lead to vanishing or exploding gradients, which simply means that the gradient