Deep Learning, Regularisation, Optimization Algorithms, Deep Neural Networks, Gradient Descent.
more quickly. And this, in turn, makes the algorithm run much faster. Vanishing / Exploding gradients While training deep neural networks, sometimes the derivatives (slopes) can become either very big or very small. It can make the training phase quite difficult. This is the problem of vanishing /