Backpropagation, Mathematics, Calculus, Machine Learning, Neural Networks.
θ2 So now we just have to calculate three other derivatives. Something interesting happens when we take the derivative of ∂z2 / ∂a1. Recall that before, when we were finding the derivatives w.r.t each of the weights in the second layer, that we calculated that each of the weight’s derivatives w.r.t