.
A) and MLP blocks (Eq. 2, 3). Layernorm (LN) is applied before every block, and residual connections after every block. The MLP contains two layers with a GELU non-linearity. Key insights here: Trick is converting fixed sized image patches to equivalent of token embeddings in NLP which are input to