Deep Learning, Regularisation, Optimization Algorithms, Deep Neural Networks, Gradient Descent.
α*dW[l] β[l] = β[l] - α*dβ[l] Note that this also works with momentum, RMSprop and Adam. How does Batch Norm work? In the case of logistic regression, we now know how normalizing the inputs helps to speed up the learning. Batch norm works in much the same way. Let’s take one more use case to