Deep Learning, Artificial Intelligence, Image Classification, Self Supervised Learning, Distillation.
2020 NeurIPS, Over 50 Citations (Sik-Ho Tsang @ Medium) Self-Supervised Learning 1993 … 2022 [BEiT] [BEiT V2] [Masked Autoencoders (MAE)] [DiT] [SimMIM] A model compression method, CompRess, is proposed to compress an already learned, deep self-supervised model (teacher) to a smaller one (student).