Gradient Descent, Gradient Boosting.
Calculates the gradient at expected future position of the model’s parameters. 6. Adegrad — Adaptive learning rate optimization algorithm. Based on historical gradient information. Faster convergence for sparse datasets. 7. Adam — Adaptive learning rate optimization algorithm. Combines the