Artificial Intelligence, Machine Learning, Deep Learning, Neural Networks.
etc., that are helpful in optimizing for the right learning rates. Global vs Local We’ve been talking about global minima. However, not all loss functions are simple convex functions with only one minima. Taking the analogy of mountainous terrain, there can be various irregular features like holes,