Derivatives, Sigmoid Function, Tanh Function, Relu.
📚Chapter4: Shallow Neural Network When you implement back propagation for your neural network, you need to either compute the slope or the derivative of the activation functions. So, let’s take a look at our choices of activation functions and how you can compute the slope of these functions.