Artificial Intelligence, Neural Networks, Calculus, Gradient Descent, Math.
chain rule. We’ll define our intermediate variables as: Image 14: Intermediate variables for loss function *Note, the u and v here are different from the u and v used in the previous section. Let’s compute the gradient with respect to the weights w first. Gradient With Respect to Weights u is