Deep Learning, Activation Functions, Machine Learning.
complex relationships. Activation functions are also used at output layer. An Activation function have following basic requirements. Computationally Inexpensive Differentiable Zero centered Below diagram gives us rough idea when to use which activation function at hidden layer, based on the Neural