Linear Regression, Machine Learning, Introduction, Gradient Descent.
size of the steps is called learning rate (𝛼) and is a so-called hyperparameter we have to optimize during the training process. The size of α is influencing the convergence of the algorithm. If it is very small the convergence to the minimum takes very long. If on the other hand, it is too large