Machine Learning, Data Science, Loss Function, Regression, Classification.
with different learning rates: 3. Huber Loss The Huber loss combines the best properties of MSE and MAE. It is quadratic for smaller errors and is linear otherwise (and similarly for its gradient). It is identified by its delta parameter: We obtain the below plot for 500 iterations of weight update