Explained, Deep Learning, Hyperparameter, AI, Backpropagation.
w = w + dw? If you imagine the process of minimizing the error (loss function) as walking down a hill, the learning rate dictates how big each step is. Ideally, we want to control this process and take smaller steps to change the variables. We need a balance. Here are a few reasons: Overshooting: