Deep Learning, Computer Vision, Cnn, Transformers, AI.
designed to be invariant to translations, ViTs are not inherently invariant to such geometric transformations. This is because the attention mechanism in ViTs considers global information, making the model more sensitive to positional changes. However, this sensitivity can be mitigated by