Deep Learning, Regularisation, Optimization Algorithms, Deep Neural Networks, Gradient Descent.
variance of these activations (a[2]) in order to make the training of w[3], b[3] more effective? This is how batch normalization works. We normalize the activations of the hidden layer(s) so that the weights of the next layer can be updated faster. Technically, we normalize the values of z[2] and