Forward Propagation, Backward Propagation.
has a ReLU activation function. Then go to the second layer, maybe uses another ReLU activation function, goes to the third layer maybe has a sigmoid activation function if you’re doing binary classification, and this outputs y-hat. Then using y-hat, you can compute the loss. This allows you to