Optimizer, Gradient Descent, Machine Learning, Adam, Sgd.
several times. More the number of layers, more number of multiplications. Now, if the weights are initialized with very high values, the gradient value will explode, this is called exploding Gradient Problem. Similarly, if the values of the weights are low, the gradient value almost vanishes due to