Model

Size
GPT-4+OCR ∼1T
Llama2+OCR
7B
1B
DocLLM-1B
DocLLM-7B
7B

Setting DocVQA KLC
KIE
45.9
27.8
40.1
49.9

VQA
82.8
47.4
53.5
63.4

STDD
STDD

ZS
ZS

BizDocs

VQA KIE CLS
84.9
76.4
48.4
40.9
20.8
65.5
73.3
31.1

66.1
10.8
63.0
72.6

(a) Causal decoder

(b) Prefix decoder

Figure 3: A simplified illustration of attention masks for causal-decoder and prefix-decoder for block infilling.
DOCLLM