Loss Function, Data Science, Heartbeat, Data Science For Ml.
more robust to outliers than MSE. One big problem in using MAE loss (for neural nets especially) is that its gradient is the same throughout, which means the gradient will be large even for small loss values. This isn’t good for learning. To fix this, we can use dynamic learning rate which