Forward Propagation, Backward Propagation.
with just a single hidden layer. As a reminder, this times is element-wise product, so all you need is those four equations to implement your backward function. Then finally, I’ll just write out a vectorized version. So the first line becomes dz^l equals da^l element-wise product with g^l prime of