Deep Learning, Regularisation, Optimization Algorithms, Deep Neural Networks, Gradient Descent.
formula: z[l]= w[l]a[l-1]+ b[l] Hence, the z-value will be less. If we use the tanh activation function, these low values of z[l] will lie near the origin: Here we are using only the linear region of the tanh function. This will make every layer in the network roughly linear, i.e., we will get