Artificial Intelligence, Neural Networks, Calculus, Gradient Descent, Math.
neuron: Image 10: Derivative with respect to the weights of our neuron: max(0, sum(w⊗x)+b) And substitute z=w∙x+b back in: Image 11: Substituting w∙x+b for z Voila! We have our derivative for a neuron with respect to its weights! Similarly, we can use the same steps for the bias: Image 12: