Deep Learning, Artificial Intelligence, Image Classification, Vision Transformer, Transformers.
module is residual connected to a regular strided CONV to form a local-global manner, similar to the downsampling bottlenecks (ResNet) or inverted bottlenecks (MobileNetV2). As shown in Tab. 1, with slightly more parameters and latency overhead, the accuracy is further improved to 81.8% with