Deep Learning, Regularisation, Optimization Algorithms, Deep Neural Networks, Gradient Descent.
recall how a logistic regression looks like: We have seen how normalizing the input in this case can speed up the learning process. In case of deep neural networks, we have a lot of hidden layers and this results in a lot of activations: Wouldn’t it be great if we can normalize the mean and