Deep Learning, Artificial Intelligence, Image Classification, Vision Transformer, Transformers.
information via the self-attention. This approach requires quadratic computation time. The output zi of the all-attention fusion scheme can be expressed as: where fi(·) and gi(·) are the projection and back-projection functions to align the dimension. 2.2. (b) Class Token Fusion The CLS token can