Deep Learning, Artificial Intelligence, Image Classification, Vision Transformer, Transformers.
CMT-S The proposed CMT block consists of a local perception unit (LPU), a lightweight multi-head self-attention (LMHSA) module, and an inverted residual feed-forward network (IRFFN). 1.1. Local Perception Unit (LPU) The absolute positional encoding used in previous Transformers, initially designed