NLP, Ocr, Deep Learning, Open Source, Computer Vision.
of how Donut works. Original image (A), split into non-overlapping patches (B), shifted window self-attention module learns relationship between different parts of the image (C), two-layer MLP learns patterns within each patch (D), patch merging (E), final tokens (F), BART taking tokens as input