Deep Learning, Artificial Intelligence, Image Classification, Vision Transformer, Small Data.
well as their neighboring features. On channel aspect, a dynamic feature aggregation module in MLP and a brand new “head token” design in multi-head self-attention module are introduced to help re-calibrate channel representation and make different channel group representation interacts with each