Deep Learning, Activation Functions, Machine Learning.
the function are prominent in -3 to 3 range. Values outside this range gradients become zero. 3. Centered around 0.5. This makes output of all neurons to be of same sign. Tanh 1. Transforms the values between -1 & 1. 2. Zero centered. Hence gradients move in either direction. A general problem with