Deep Learning, Artificial Intelligence, Image Classification, Vision Transformer, Transformers.
operators used in ViT-based models and identify inefficient designs. Then a dimension-consistent pure Transformer (without MobileNet blocks) is introduced as a design paradigm. Finally, latency-driven slimming is performed to get a series of final models dubbed EfficientFormer. Later,