Calculus, Backpropagation, Neural Networks, Mathematics, AI.
easy. In multiclass, where the output of our algorithm is a vector, we use softmax to turn a vector of z’s into probabilities. Cool. So, finding the derivatives of a cost function is like finding the derivatives of a big composite function. And this is where the idea of backpropagation comes from.