Deep Learning, Artificial Intelligence, Image Classification, Self Supervised Learning, Distillation.
MobileNetV2, and ResNet-18). On AlexNet, it outperforms even the supervised model. Table 6 shows the results of linear classifier using only 1% and 10% of ImageNet for ResNet-50. Table 6: Smaller ImageNet, Table 7: PASCAL-VOC. Table 6: ResNet-50 distilled from ResNet-50×4 has competitive or even