Deep Learning, Artificial Intelligence, Image Classification, Vision Transformer, Transformers.
X0 is the input image with batch size as B and spatial size as [H, W], Y is the desired output, and m is the total number of blocks (depth). MB consists of unspecified token mixer (TokenMixer) followed by a MLP block: where Xi|i>0 is the intermediate feature that forwarded into the ith MB. Stage