Deep Learning, Activation Functions, Machine Learning.
values, leaky ReLU has a small slope for negative values. 2. Its faster than ReLU. 3. Its more balanced than ReLU. SeLU It combines good parts of both ReLU & Leaky ReLU. It uses scaled (log curve) for negative values. Since it has large negative slope for negative values it make those neurons