Deep Learning, Artificial Intelligence, Image Classification, Vision Transformer, Transformers.
attention downsampling. 1.6. EfficientFormerV2 Design A 4-stage hierarchical design is used which obtains feature sizes in {1/4, 1/8, 1/16, 1/32} of the input resolution. Stems: EfficientFormerV2 starts with a small kernel convolution stem to embed input image instead of using inefficient embedding