Artificial Intelligence, Neural Networks, Calculus, Gradient Descent, Math.
function with respect to v Multiplying the two together to find the derivative of C with respect to b, and substituting in y-u for v, and max(0, w∙x +b) for u, we get: Image 30: Derivative of cost function with respect to the bias Once again, because the second line explicitly states that w∙x+b>0,