Deep Learning, Artificial Intelligence, Image Classification, Vision Transformer, Transformers.
2.0% higher than CPVT, indicating the benefit of CMT block for capturing both local and global information. Note that all previous Transformer-based models are still inferior to EfficientNet which is obtained via a thorough architecture search, however, CMT-S is 0.6% higher than EfficientNet-B4