Open foundation models for Azerbaijani language
<|reference_start|>Open foundation models for Azerbaijani language: The emergence of multilingual large language models has enabled the development of language understanding and generation systems in Azerbaijani. However, most of the production-grade systems rely on cloud solutions, such as GPT-4. While there have been several attempts to develop open foundation models for Azerbaijani, these works have not found their way into common use due to a lack of systemic benchmarking. This paper encompasses several lines of work that promote open-source foundation models for Azerbaijani. We introduce (1) a large text corpus for Azerbaijani, (2) a family of encoder-only language models trained on this dataset, (3) labeled datasets for evaluating these models, and (4) extensive evaluation that covers all major open-source models with Azerbaijani support.<|reference_end|>
@article{isbarov2024open,
    title={Open foundation models for Azerbaijani language},
    author={Jafar Isbarov, Kavsar Huseynova, Elvin Mammadov, Mammad Hajili, Duygu
  Ataman},
    journal={arXiv preprint arXiv:2407.02337},
    year={2024},
    archivePrefix={arXiv},
    eprint={2407.02337},
    primaryClass={cs.CL}
}