NLP, Ocr, Deep Learning, Open Source, Computer Vision.
shifted window-based multi-head self-attention module — this simply helps the model understand the relationship between different parts of the image by considering the content of nearby patches. Next, a two-layer MLP allows the model to learn patterns within each patch and thus have a better