Derivatives, Sigmoid Function, Tanh Function, Relu.
sets g prime to either 0.01 or or to 1, either way, it doesn’t really matter. When z is exactly 0, your code will work just. So, under these formulas, you should either compute the slopes or the derivatives of your activation functions. Now that we have this building block, you’re ready to see how