title: Meltemi: The first open Large Language Model for Greek
summary: We describe the development and capabilities of Meltemi 7B, the first open
  Large Language Model for the Greek language. Meltemi 7B has 7 billion
  parameters and is trained on a 40 billion token Greek corpus. For the
  development of Meltemi 7B, we adapt Mistral, by continuous pretraining on the
  Greek Corpus. Meltemi 7B contains up-to-date information up to September 2023.
  Furthermore, we have translated and curated a Greek instruction corpus, which
  has been used for the instruction-tuning of a chat model, named Meltemi 7B
  Instruct. Special care has been given to the alignment and the removal of toxic
  content for the Meltemi 7B Instruct. The developed models are evaluated on a
  broad set of collected evaluation corpora, and examples of prompts and
  responses are presented. Both Meltemi 7B and Meltemi 7B Instruct are available
  at https://huggingface.co/ilsp under the Apache 2.0 license.
paper_authors._id: 66a9c4a585f81589aae3e68b
paper_authors.name: Leon Voukoutis
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-31T08:36:49.284Z
paper_authors._id: 648724a02b9aa290e85d33a4
paper_authors.avatarUrl: /avatars/c7d7fe9519a7d873158e41e141a8bfde.svg
paper_authors.fullname: Leon Voukoutis
paper_authors.type: user
paper_authors.user: LVouk
paper_authors._id: 66a9c4a585f81589aae3e68c
paper_authors.name: Dimitris Roussis
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-31T08:36:54.903Z
paper_authors._id: 6366fe0ba2abcdf2fd6be58b
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/6366fe0ba2abcdf2fd6be58b/5Uy79Kr-TTCXYYU-sqsX9.jpeg
paper_authors.fullname: Dimitris Roussis
paper_authors.type: user
paper_authors.user: droussis
paper_authors._id: 66a9c4a585f81589aae3e68d
paper_authors.name: Georgios Paraskevopoulos
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-31T08:37:16.127Z
paper_authors._id: 639215a81bae0dde85842ab8
paper_authors.avatarUrl: /avatars/7bb312cb899b622929d262a22b584b53.svg
paper_authors.fullname: Georgios Paraskevopoulos
paper_authors.type: user
paper_authors.user: geopar
paper_authors._id: 66a9c4a585f81589aae3e68e
paper_authors.name: Sokratis Sofianopoulos
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-31T08:37:22.021Z
paper_authors._id: 62c539a0aa6319a2dbd79327
paper_authors.avatarUrl: /avatars/de9fdedfa8720977a0b5c80b3c167ce8.svg
paper_authors.fullname: Sokratis Sofianopoulos
paper_authors.type: user
paper_authors.user: soksof
paper_authors._id: 66a9c4a585f81589aae3e68f
paper_authors.name: Prokopis Prokopidis
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-31T08:37:28.059Z
paper_authors._id: 64be828ce90972519da1cc39
paper_authors.avatarUrl: /avatars/b82555ebff59dce461ab3a1256ae4ba6.svg
paper_authors.fullname: Prokopis Prokopidis
paper_authors.type: user
paper_authors.user: pprokopidis
paper_authors._id: 66a9c4a585f81589aae3e690
paper_authors.name: Vassilis Papavasileiou
paper_authors._id: 66a9c4a585f81589aae3e691
paper_authors.name: Athanasios Katsamanis
paper_authors._id: 66a9c4a585f81589aae3e692
paper_authors.name: Stelios Piperidis
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-31T08:37:50.385Z
paper_authors._id: 65aa4ab19aba49e1d0047930
paper_authors.avatarUrl: /avatars/a2748a7e79b9a6e13ca96b36812397b6.svg
paper_authors.fullname: Stelios Piperidis
paper_authors.type: user
paper_authors.user: spiper
paper_authors._id: 66a9c4a585f81589aae3e693
paper_authors.name: Vassilis Katsouros
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-31T08:38:05.470Z
paper_authors._id: 61c17fa04fcde74777ea5862
paper_authors.avatarUrl: /avatars/bef5b64645219c7957529b9782a53ecd.svg
paper_authors.fullname: Katsouros
paper_authors.type: user
paper_authors.user: Vassilis
paper_title: Meltemi: The first open Large Language Model for Greek
paper_summary: We describe the development and capabilities of Meltemi 7B, the first open
  Large Language Model for the Greek language. Meltemi 7B has 7 billion
  parameters and is trained on a 40 billion token Greek corpus. For the
  development of Meltemi 7B, we adapt Mistral, by continuous pretraining on the
  Greek Corpus. Meltemi 7B contains up-to-date information up to September 2023.
  Furthermore, we have translated and curated a Greek instruction corpus, which
  has been used for the instruction-tuning of a chat model, named Meltemi 7B
  Instruct. Special care has been given to the alignment and the removal of toxic
  content for the Meltemi 7B Instruct. The developed models are evaluated on a
  broad set of collected evaluation corpora, and examples of prompts and
  responses are presented. Both Meltemi 7B and Meltemi 7B Instruct are available
  at https://huggingface.co/ilsp under the Apache 2.0 license.
paper_ai_summary: Developers created Meltemi 7B, a 7 billion parameter open-source large language model for Greek, trained on a 40 billion token corpus, and enhanced with instruction-tuning for chat applications.
paper_ai_keywords: Large Language Model Mistral Greek Corpus instruction-tuning prompt response