Machine Learning, Neural Networks, Backpropagation, Gradient Descent.
* |dE/dw| So, the distance to move is the product of learning rate parameter alpha and the magnitude of change in error with a change in weight at that point. Now, we need to decide the Learning Rate very carefully. If it is very large the values of weights will be changed with a great amount and