Deep Learning, Artificial Intelligence, Image Classification, Self Supervised Learning, Distillation.
anchor points on the student network. Finally, since the teacher is frozen, the student is optimized by solving: 1.3. Implemenations A memory bank: of anchor points from several most recent iterations, is maintained, similar to MoCo v2. Memory bank size of 128,000 is used. Moving average weight for