Deep Learning, Machine Learning, Artificail Intelligence, Neural Networks, Activation Functions.
used for hidden layers. It is also effective at overcoming the limitations of other previously popular activation functions, such as Sigmoid and Tanh. Specifically, it is less susceptible to vanishing gradient descent problem that prevents deep models from being trained, although it can suffer from