Deep Learning, Regularisation, Optimization Algorithms, Deep Neural Networks, Gradient Descent.
end up making the network simpler and thus reduce overfitting: Let’s understand this concept through one more example. Suppose we use the tanh activation function: Now, if we set ƛ to a large value, the weight of the units w[l] will be less. To calculate the z[l] value, we will use the following