Deep Learning, Artificial Intelligence, Image Classification, Self Supervised Learning, Distillation.
The student model is trained so that it mimics the relative similarity between the datapoints in the teacher’s embedding space. This is the first time a self-supervised AlexNet has outperformed supervised one on ImageNet classification. Outline CompRess Results Impacts 1. CompRess CompRess Model