Deep Learning, Artificial Intelligence, Image Classification, Self Supervised Learning, Distillation.
cannot augment the images at teacher side. 1.4. Models Three teachers: (a) ResNet-50 model which is trained using MoCo v2 method for 800 epochs [10], (b) ResNet-50 trained with SwAV [8] for 800 epochs, and (c) ResNet-50×4 model which is trained using SimCLR method for 1000 epochs. Compressing from