Gradient Descent, Gradient Boosting.
of models or depth of the trees is too large. Overfitting can be avoided by using regularization techniques such as early stopping, pruning, and shrinkage. There are various types of gradient boosting available: 1. Gradient boosting machines(GBMs) — It uses decision trees as its weak learners.