Arctic-TILT Business Document Understanding at Sub-Billion Scale
<|reference_start|>Arctic-TILT Business Document Understanding at Sub-Billion Scale: The vast portion of workloads employing LLMs involves answering questions grounded on PDF or scan content. We introduce the Arctic-TILT achieving accuracy on par with models 1000$\times$ its size on these use cases. It can be fine-tuned and deployed on a single 24GB GPU, lowering operational costs while processing Visually Rich Documents with up to 400k tokens. The model establishes state-of-the-art results on seven diverse Document Understanding benchmarks, as well as provides reliable confidence scores and quick inference, which are essential for processing files in large-scale or time-sensitive enterprise environments.<|reference_end|>
@article{borchmann2024arctic-tilt.,
    title={Arctic-TILT. Business Document Understanding at Sub-Billion Scale},
    author={{L}ukasz Borchmann and Micha{l} Pietruszka and Wojciech Ja'skowski
  and Dawid Jurkiewicz and Piotr Halama and Pawe{l} J'oziak and {L}ukasz
  Garncarek and Pawe{l} Liskowski and Karolina Szyndler and Andrzej Gretkowski
  and Julita O{l}tusek and Gabriela Nowakowska and Artur Zaw{l}ocki and
  {L}ukasz Duhr and Pawe{l} Dyda and Micha{l} Turski},
    journal={arXiv preprint arXiv:2408.04632},
    year={2024},
    archivePrefix={arXiv},
    eprint={2408.04632},
    primaryClass={cs.CL cs.CV}
}