Deep Learning, Artificial Intelligence, Image Classification, Self Supervised Learning, Distillation.
method outperforms other distillation methods on all evaluation benchmarks. Table 2: Full ImageNet, Table 3: Fewer-Label ImageNet. Table 2: SwAV ResNet-50 is used as the teacher and compress it to ResNet-18. Better accuracy is obtained compared to other distillation methods. Table 3: For 1-shot,