Optimizer, Gradient Descent, Machine Learning, Adam, Sgd.
the vertical component of the movement as much as possible. So, we have listed the three important challenges of the gradient descent mechanisms. Now, let's see the solutions. Solutions Weight Initialization The method of weight initiation is used to solve our 2nd problem which is the exploding and