Machine Learning, Gradient Descent, Data Visualization, Data Science.
algorithm later. sum_of_gradient = gradient + previous_sum_of_gradient * decay_rate (eq. 3) delta = -learning_rate * sum_of_gradient (eq. 4) theta += delta (eq. 5) (What I did was factoring out -learning_rate. To see the mathematical equivalence, you can substitute delta with -learning_rate *