Forward Propagation, Backward Propagation.
respect to y-hat can be shown to be what it is. If you’re familiar with calculus, if you look up the loss function l and take derivatives with respect to y-hat with respect to a, you can show that you get that formula. This is the formula you should use for da, for the final layer, capital L. Of