Machine Learning, Gradient Descent, Linear Regression, Python, Optimization.
Now let’s run the above program for different values of learning rate(alpha). For alpha = 0.0005 , the output will look like this: For alpha = 0.05 , it will look like this: For alpha = 1, it will overshoot the minimum point and diverge like this: The gradient descent algorithm about which we