Deep Learning, Artificial Intelligence, Image Classification, Vision Transformer, Transformers.
information among the patch tokens from the other branch and then back project it to its own branch. Cross-attention module for Large branch. Specifically, for branch l, it first collects the patch tokens from the S-Branch and concatenates its own CLS tokens to them, as shown above. Mathematically,