Deep Learning, Artificial Intelligence, Convolutional Network, Image Classification, Resnet.
a larger progress. Authors follow ResNet to choose 0.1 as the initial learning rate for batch size 256, then when changing to a larger batch size b, the initial learning rate is increased to 0.1×b/256. 2.1.2. Learning Rate Warmup At the beginning of the training, all parameters are typically random