Deep Learning, Artificial Intelligence, Convolutional Network, Image Classification, Resnet.
FP32 but over 100 TFLOPS in FP16. As in the above table, the overall training speed is accelerated by 2 to 3 times after switching from FP32 to FP16 on V100. The model trained with 1024 batch size and FP16 even slightly increased 0.5% top-1 accuracy compared to the baseline model. The breakdown