my understanding is that this example is implementing Relu activation function.  I need to implement Loss function for specific case where the last layer’s derivative is calculated manually and is back propagated through the network using chain rule.