Artificial Intelligence, Neural Networks, Calculus, Gradient Descent, Math.
represents the slope, or how much we have to move our weights by in order to minimize our error. If our neural network has just begun training, and has a very low accuracy, the error will be high and thus the derivative will be large as well. Therefore, we will have to take a big step in order to