Gradient Descent, Machine Learning.
respect to w, we could either: Expand the formula and perform the partial derivatives one component at the time (see first two lines in the figure), or Perform the differentiation with respect to the vectors as a whole (see last two lines in the figure). Example of finding the gradient of f w.r.t.