Deep Learning, Neural, Neural Networks, Recurrent Neural Network, AI.
max(0,z) It introduces non-linearity and is computationally efficient, making it a liked option for hidden layers in neural networks. 4.1.2.3 Hyperbolic Tangent (Tanh) Tanh is alike to the sigmoid method but maps z to an output value amongst -1 & 1: Figure 3 - Hyperbolic Tangent Tanh is often used