Optimizer, Gradient Descent, Machine Learning, Adam, Sgd.
types of curves. Convex Curve This is a convex curve. It has a single global minimum. So, where ever we initialize any point we can use the gradients to reach the global minimum. If we consider the points as our weights and the curve as the loss function, we can easily converge to the minimum of