4.3 Downstream Evaluation

Experimental settings. We investigate two experimental settings:

• Same Datasets, Different Splits (SDDS): Following previous work in VRDU [34, 59, 33, 12, 31, 32], we
first evaluate DocLLM on the unseen test split (or dev split when test split is unavailable) of each of the 16
datasets composing the instruction-tuning data. The motivation behind this very typical setting is to check how
DocLLM performs when tasks and domains supposedly stay the same from train to test.
DOCLLM