Nile-Chat: Egyptian Language Models for Arabic and Latin Scripts
We introduce Nile-Chat-4B, 3x4B-A6B, and 12B, a collection of LLMs for
Egyptian dialect, uniquely designed to understand and generate texts written in
both Arabic and Latin scripts. Specifically, with Nile-Chat-3x4B-A6B, we
introduce a novel language adaptation approach by leveraging the
Branch-Train-MiX strategy to merge script-specialized experts, into a single
MoE model. Our Nile-Chat models significantly outperform leading multilingual
and Arabic LLMs, such as LLaMa, Jais, and ALLaM, on our newly introduced
Egyptian evaluation benchmarks, which span both understanding and generative
tasks. Notably, our 12B model yields a 14.4% performance gain over
Qwen2.5-14B-Instruct on Latin-script benchmarks. All our resources are publicly
available. We believe this work presents a comprehensive methodology for
adapting LLMs to dual-script languages, addressing an often overlooked aspect
in modern LLM development.
686e2b0aa5f0f70d9de40c80
Guokan Shang
claimed_verified
2025-07-09T08:49:05.228Z
6087e598e2b7cc3a117b0dc5
https://cdn-avatars.huggingface.co/v1/production/uploads/6087e598e2b7cc3a117b0dc5/Ctz_W-uo1gOQRBHXalD1P.png
Guokan Shang
user
guokan-shang
686e2b0aa5f0f70d9de40c81
Hadi Abdine
claimed_verified
2025-07-09T14:40:52.030Z
66448b4fecac3bc79b26304f
https://cdn-avatars.huggingface.co/v1/production/uploads/66448b4fecac3bc79b26304f/aPH3UFbc20CL2Bz2yn7nH.jpeg
Hadi Abdine
user
habdine
686e2b0aa5f0f70d9de40c82
Ahmad Chamma
claimed_verified
2025-07-09T14:40:47.916Z
6751b0caecaa275e389dd5eb
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/RI2Y_nnjg5xJnv5sJVx_v.png
Ahmad Chamma
user
AC-723
686e2b0aa5f0f70d9de40c83
Amr Mohamed
claimed_verified
2025-07-09T14:40:50.004Z
655efd24afee0e00788bb589
https://cdn-avatars.huggingface.co/v1/production/uploads/655efd24afee0e00788bb589/22guLxIWNybbJR3jI-c4w.jpeg
Amr Mohamed
user
amr-mohamed
686e2b0aa5f0f70d9de40c84
Mohamed Anwar
claimed_verified
2025-07-09T14:40:44.048Z
624331b8c927fd9d912b5819
https://cdn-avatars.huggingface.co/v1/production/uploads/1648570759533-noauth.png
Mohamed Anwar
user
anwarvic
686e2b0aa5f0f70d9de40c85
Abdelaziz Bounhar
claimed_verified
2025-07-09T14:40:41.336Z
6380e53efb49cd1c12052c17
https://cdn-avatars.huggingface.co/v1/production/uploads/6380e53efb49cd1c12052c17/b5CweexfrVn-W_xto2agR.jpeg
Abdelaziz Bounhar
user
BounharAbdelaziz
686e2b0aa5f0f70d9de40c86
Omar El Herraoui
claimed_verified
2025-07-11T08:03:45.323Z
64882532763f894d8974e0fa
/avatars/bcc17023c11acef45ccb73ec1dd3ef2d.svg
Omar El Herraoui
user
oe2015
686e2b0aa5f0f70d9de40c87
Preslav Nakov
claimed_verified
2025-07-09T14:40:46.092Z
647f7eb25e1bc4753746bf9f
/avatars/cc9c6210fdc822d8a106937e747dff41.svg
Preslav Nakov
user
preslavnakov
686e2b0aa5f0f70d9de40c88
Michalis Vazirgiannis
686e2b0aa5f0f70d9de40c89
Eric Xing
Nile-Chat: Egyptian Language Models for Arabic and Latin Scripts
We introduce Nile-Chat-4B, 3x4B-A6B, and 12B, a collection of LLMs for
Egyptian dialect, uniquely designed to understand and generate texts written in
both Arabic and Latin scripts. Specifically, with Nile-Chat-3x4B-A6B, we
introduce a novel language adaptation approach by leveraging the
Branch-Train-MiX strategy to merge script-specialized experts, into a single
MoE model. Our Nile-Chat models significantly outperform leading multilingual
and Arabic LLMs, such as LLaMa, Jais, and ALLaM, on our newly introduced
Egyptian evaluation benchmarks, which span both understanding and generative
tasks. Notably, our 12B model yields a 14.4% performance gain over
Qwen2.5-14B-Instruct on Latin-script benchmarks. All our resources are publicly
available. We believe this work presents a comprehensive methodology for
adapting LLMs to dual-script languages, addressing an often overlooked aspect
in modern LLM development.
Nile-Chat models, using a Branch-Train-MiX strategy, outperform existing multilingual and Arabic LLMs on Egyptian dialect benchmarks, particularly in dual-script understanding and generation.
LLMs Egyptian dialect Arabic Latin scripts Branch-Train-MiX MoE model multilingual Jais ALLaM Egyptian evaluation benchmarks Qwen2.5-14B-Instruct