title: EuroLLM: Multilingual Language Models for Europe
summary: The quality of open-weight LLMs has seen significant improvement, yet they
  remain predominantly focused on English. In this paper, we introduce the
  EuroLLM project, aimed at developing a suite of open-weight multilingual LLMs
  capable of understanding and generating text in all official European Union
  languages, as well as several additional relevant languages. We outline the
  progress made to date, detailing our data collection and filtering process, the
  development of scaling laws, the creation of our multilingual tokenizer, and
  the data mix and modeling configurations. Additionally, we release our initial
  models: EuroLLM-1.7B and EuroLLM-1.7B-Instruct and report their performance on
  multilingual general benchmarks and machine translation.
paper_authors._id: 66f397fa734b9d57499abc4e
paper_authors.name: Pedro Henrique Martins
paper_authors._id: 66f397fa734b9d57499abc4f
paper_authors.name: Patrick Fernandes
paper_authors._id: 66f397fa734b9d57499abc50
paper_authors.name: João Alves
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-10-23T15:06:57.379Z
paper_authors._id: 61ae32477b23f65fc71a62e4
paper_authors.avatarUrl: /avatars/3acf15ac95847c0d55205f16cba7b0f8.svg
paper_authors.fullname: João Alves
paper_authors.type: user
paper_authors.user: joaomiguel26
paper_authors._id: 66f397fa734b9d57499abc51
paper_authors.name: Nuno M. Guerreiro
paper_authors._id: 66f397fa734b9d57499abc52
paper_authors.name: Ricardo Rei
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-09-30T08:07:24.987Z
paper_authors._id: 60d9a9791fa5d458da77754d
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/1624887555363-60d9a9791fa5d458da77754d.jpeg
paper_authors.fullname: Ricardo Rei
paper_authors.type: user
paper_authors.user: RicardoRei
paper_authors._id: 66f397fa734b9d57499abc53
paper_authors.name: Duarte M. Alves
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-03-10T09:53:01.222Z
paper_authors._id: 64132452d8a418df415a6ded
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/64132452d8a418df415a6ded/qkjL5G89uldHUXlCI3n4f.jpeg
paper_authors.fullname: Duarte Alves
paper_authors.type: user
paper_authors.user: DuarteMRAlves
paper_authors._id: 66f397fa734b9d57499abc54
paper_authors.name: José Pombal
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-09-27T13:47:41.575Z
paper_authors._id: 6408b9d79e9f790c905398a2
paper_authors.avatarUrl: /avatars/23a28a84d1d465c3beb2f2fbb6723a75.svg
paper_authors.fullname: José Maria Pombal
paper_authors.type: user
paper_authors.user: jmprcp
paper_authors._id: 66f397fa734b9d57499abc55
paper_authors.name: Amin Farajian
paper_authors._id: 66f397fa734b9d57499abc56
paper_authors.name: Manuel Faysse
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-10-04T20:11:35.602Z
paper_authors._id: 60f2e021adf471cbdf8bb660
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/1654090481550-60f2e021adf471cbdf8bb660.jpeg
paper_authors.fullname: Manuel Faysse
paper_authors.type: user
paper_authors.user: manu
paper_authors._id: 66f397fa734b9d57499abc57
paper_authors.name: Mateusz Klimaszewski
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-09-30T15:51:24.429Z
paper_authors._id: 6579dcdabd88c2afe8665a0e
paper_authors.avatarUrl: /avatars/f64a729250c207a76fd31d7daa3e58b6.svg
paper_authors.fullname: Mateusz Klimaszewski
paper_authors.type: user
paper_authors.user: mklimasz
paper_authors._id: 66f397fa734b9d57499abc58
paper_authors.name: Pierre Colombo
paper_authors._id: 66f397fa734b9d57499abc59
paper_authors.name: Barry Haddow
paper_authors._id: 66f397fa734b9d57499abc5a
paper_authors.name: José G. C. de Souza
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-10-18T08:25:45.508Z
paper_authors._id: 63eb70a713a3eb9b0dc757b5
paper_authors.avatarUrl: /avatars/877d0b0cb5472d82f75653ec0fe76677.svg
paper_authors.fullname: José G. C. de Souza
paper_authors.type: user
paper_authors.user: josesouza
paper_authors._id: 66f397fa734b9d57499abc5b
paper_authors.name: Alexandra Birch
paper_authors._id: 66f397fa734b9d57499abc5c
paper_authors.name: André F. T. Martins
paper_title: EuroLLM: Multilingual Language Models for Europe
paper_summary: The quality of open-weight LLMs has seen significant improvement, yet they
  remain predominantly focused on English. In this paper, we introduce the
  EuroLLM project, aimed at developing a suite of open-weight multilingual LLMs
  capable of understanding and generating text in all official European Union
  languages, as well as several additional relevant languages. We outline the
  progress made to date, detailing our data collection and filtering process, the
  development of scaling laws, the creation of our multilingual tokenizer, and
  the data mix and modeling configurations. Additionally, we release our initial
  models: EuroLLM-1.7B and EuroLLM-1.7B-Instruct and report their performance on
  multilingual general benchmarks and machine translation.
paper_ai_summary: The EuroLLM project develops multilingual language models for European Union languages, detailing data collection, tokenizer creation, and model performance.
paper_ai_keywords: open-weight LLMs EuroLLM project multilingual LLMs scaling laws multilingual tokenizer data mix modeling configurations EuroLLM-1.7B EuroLLM-1.7B-Instruct