Deep Learning, Artificial Intelligence, Image Classification, Vision Transformer, Transformers.
(or S) is defined as the stack of several MetaBlocks. The network includes 4 Stages. Among each Stage, there is an embedding operation to project embedding dimension and downsample token length, denoted as Embedding as in Fig. 3 above. EfficientFormer is a fully Transformer-based model without