Deep Learning, Artificial Intelligence, Image Classification, Vision Transformer, Transformers.
tokens) at branch i, where i can be l or s for the large (primary) or small (complementary) branch. xicls and xipatch represent CLS and patch tokens of branch i, respectively. 2.1. (a) All-Attention A straightforward approach is to simply concatenate all the tokens from both branches, and then fuse