Deep Learning, Activation Functions, Machine Learning.
positive domain, ReLU or its variant are not considered good fit for being used in RNN. RNN prefer bounded activation functions. Activation function for Output layer Softmax 1. Transforms number into probability distribution 2. Gives “confidence score” for each class 3. Sum of scores will be 1