Artificial Intelligence, Neural Networks, Calculus, Gradient Descent, Math.
dot product This is once again a composition of functions, so we can write v = w⊗x and u=sum(v). We’re trying to find the derivative of u with respect to w. We’ve learned about both of these functions — element-wise multiplication and summation — before in Part 3. Their derivatives are: Image 5: