Deep Learning, Artificial Intelligence, Image Classification, Vision Transformer, Small Data.
maps are then reshaped as patch tokens and concatenated with a class token, and are fed into encoder layers. Each encoder contains Layer Normalization, multi-head self-attention and feed forward network. The MHSA is modified as Head-Interacted Multi-Head Self-Attention (HI-MHSA) and feed forward