Deep Learning, Artificial Intelligence, Convolutional Network, Image Classification, Resnet.
proposed. 2.1. Large-Batch Training 2.1.1. Linear Scaling Learning Rate Increasing the batch size does not change the expectation of the stochastic gradient but reduces its variance. In other words, a large batch size reduces the noise in the gradient, so the learning rate may be increased to make