Machine Learning, Gradient Descent, Data Visualization, Data Science.
frictionless bowl analogy we mentioned in the beginning; you do not want that. Typically the decay rate is chosen around 0.8–0.9 — it’s like a surface with a little bit of friction so it eventually slows down and stops. Momentum (magenta) vs. Gradient Descent (cyan) on a surface with a global