Deep Learning, Artificial Intelligence, Image Classification, Self Supervised Learning, Distillation.
better performance. Table 7: Distilled AlexNet has competitive or even better performance. 2.4. Ablation Studies Ablation and Qualitative Results. 25% ImageNet is used for ablation studies. (a): The optimal temperature is 0.04. (b): A larger memory bank results in a more accurate student because