If you want to train a neural network, you have to perform backpropagation. And backprop relies on updating parameters in the direction of the derivative of a loss value w.r.t the corresponding parameter.
Thus gradient in this term means this derivative.