Deep Learning, Artificial Intelligence, Convolutional Network, Image Classification, Resnet.
effect for each effective training heuristic on ResNet-50. Increasing batch size from 256 to 1024 by linear scaling learning rate alone leads to a 0.9% decrease of the top-1 accuracy while stacking the rest three heuristics bridges the gap. Switching from FP32 to FP16 at the end of training does