Gradient Descent, Gradient Boosting.
early stopping, among other features. 3. Light gradient boosting machine(LightGBM) — Uses histogram based algorithms. Used for high dimensional datasets. 4. CatBoost — Handles categorical features in the data. It used gradient based feature selection which helps in reducing overfitting. 5.