Deep Learning, Regularisation, Optimization Algorithms, Deep Neural Networks, Gradient Descent.
note is that while making predictions, there is a slight difference in the way we use batch normalization. Batch Norm at Test Time We need to process the examples one at a time when making predictions on the test data. In the training period, the steps of batch norm can be written as: We first