Deep Learning, Artificial Intelligence, Image Classification, Self Supervised Learning, Distillation.
“Ours-2q” model achieves an accuracy close to the supervised model which has seen all labels of ImageNet in learning the features. 2.2. Downstream Tasks CUB200 and Cars196. Surprisingly, for the combination of Cars196 dataset and ResNet-50×4 teacher, the proposed model even outperforms the ImageNet