Linear Regression, Machine Learning, Introduction, Gradient Descent.
direction of the steepest descent, which is the direction of the negative gradient at this position. This is illustrated in the above plot. That is we have an iterative algorithm and in each iteration step, we update our parameter w by going a step in the direction of the negative gradient. The