Deep Learning, Computer Vision, Cnn, Transformers, AI.
DeiT: Data-efficient Image Transformers (DeiT) are a family of ViTs designed to reduce the reliance on large-scale labeled data by incorporating techniques such as distillation and mixup during training, resulting in more data-efficient and generalizable models. ViTs have demonstrated their