Machine Learning, Neural Networks, Backpropagation, Gradient Descent.
the loss function. The model found which way to move, now the model needs to find by how much it should move the weights. This is decided by a parameter called Learning Rate denoted by Alpha. the diagram we see, the weights are moved from point A to point B which are at a distance of dx. dx = alpha