Backpropagation, Neural Networks.
to take derivatives with respect to the input x, since input x for supervised learning because We’re not trying to optimize x, so we won’t bother to take derivatives, at least for supervised learning with respect to x. I’m going to skip explicitly computing da. If you want, you can actually compute