title: Jais and Jais-chat: Arabic-Centric Foundation and Instruction-Tuned Open
    Generative Large Language Models
summary: We introduce Jais and Jais-chat, new state-of-the-art Arabic-centric
  foundation and instruction-tuned open generative large language models (LLMs).
  The models are based on the GPT-3 decoder-only architecture and are pretrained
  on a mixture of Arabic and English texts, including source code in various
  programming languages. With 13 billion parameters, they demonstrate better
  knowledge and reasoning capabilities in Arabic than any existing open Arabic
  and multilingual models by a sizable margin, based on extensive evaluation.
  Moreover, the models are competitive in English compared to English-centric
  open models of similar size, despite being trained on much less English data.
  We provide a detailed description of the training, the tuning, the safety
  alignment, and the evaluation of the models. We release two open versions of
  the model -- the foundation Jais model, and an instruction-tuned Jais-chat
  variant -- with the aim of promoting research on Arabic LLMs. Available at
  https://huggingface.co/inception-mbzuai/jais-13b-chat
paper_authors._id: 64f0080606fd497b26170eca
paper_authors.name: Neha Sengupta
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-08-31T12:18:23.924Z
paper_authors._id: 6429100588215cee63b9334e
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/6429100588215cee63b9334e/L5-CPVDsIC_1mI_izizyX.jpeg
paper_authors.fullname: Neha Sengupta
paper_authors.type: user
paper_authors.user: neha1710
paper_authors._id: 64f0080606fd497b26170ecb
paper_authors.name: Sunil Kumar Sahu
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-08-31T12:19:30.906Z
paper_authors._id: 6172c8ea51681de8a2623df2
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/6172c8ea51681de8a2623df2/utzkBPCwoS4jIAHL-5m_z.jpeg
paper_authors.fullname: Sunil Kumar Sahu
paper_authors.type: user
paper_authors.user: sunilitggu
paper_authors._id: 64f0080606fd497b26170ecc
paper_authors.name: Bokang Jia
paper_authors._id: 64f0080606fd497b26170ecd
paper_authors.name: Satheesh Katipomu
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-08-31T12:20:29.321Z
paper_authors._id: 62d00768c375d0c842518541
paper_authors.avatarUrl: /avatars/2e01b90e4b5c312953ed0a883e336f00.svg
paper_authors.fullname: Satheesh K
paper_authors.type: user
paper_authors.user: satheeshkatipomu
paper_authors._id: 64f0080606fd497b26170ece
paper_authors.name: Haonan Li
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-08-31T12:20:50.483Z
paper_authors._id: 643934ecb9ac1d55f41cefd7
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/643934ecb9ac1d55f41cefd7/v41FZ2Ar6nVXEkf-w5axf.jpeg
paper_authors.fullname: Haonan Li
paper_authors.type: user
paper_authors.user: haonan-li
paper_authors._id: 64f0080606fd497b26170ecf
paper_authors.name: Fajri Koto
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-08-31T12:21:05.872Z
paper_authors._id: 643fb246c2ec31af16aa9313
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/643fb246c2ec31af16aa9313/zCDYOVGdIrncX-k9o7bM6.png
paper_authors.fullname: Fajri Koto
paper_authors.type: user
paper_authors.user: fajrikoto
paper_authors._id: 64f0080606fd497b26170ed0
paper_authors.name: Osama Mohammed Afzal
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-08-31T12:21:35.358Z
paper_authors._id: 62637f3863f73be3d2f9da5b
paper_authors.avatarUrl: /avatars/046c7096cf88f50f34516e7da1b18a0a.svg
paper_authors.fullname: Osama Mohammed Afzal
paper_authors.type: user
paper_authors.user: oafzal
paper_authors._id: 64f0080606fd497b26170ed1
paper_authors.name: Samta Kamboj
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-08-31T12:21:52.255Z
paper_authors._id: 64784adc5bf35e70ab5b747a
paper_authors.avatarUrl: /avatars/9b3b2d12ad3e1959aacfefbb931986dd.svg
paper_authors.fullname: samta kamboj
paper_authors.type: user
paper_authors.user: samta-kamboj
paper_authors._id: 64f0080606fd497b26170ed2
paper_authors.name: Onkar Pandit
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-08-31T12:22:06.899Z
paper_authors._id: 64a6660602e46deb19ad9114
paper_authors.avatarUrl: /avatars/7ecbafc435c7779769dfb1857300cbeb.svg
paper_authors.fullname: Onkar Pandit
paper_authors.type: user
paper_authors.user: onkarpandit-g42
paper_authors._id: 64f0080606fd497b26170ed3
paper_authors.name: Rahul Pal
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-08-31T12:22:22.619Z
paper_authors._id: 62f346c506b6e6f54b482a20
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/62f346c506b6e6f54b482a20/_O4wz8GpDlqCv0ZXiIngL.jpeg
paper_authors.fullname: Rahul Pal
paper_authors.type: user
paper_authors.user: rahulpal123
paper_authors._id: 64f0080606fd497b26170ed4
paper_authors.name: Lalit Pradhan
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2023-09-21T07:25:42.530Z
paper_authors._id: 640efae206c3b5ca883e5bce
paper_authors.avatarUrl: /avatars/d911cffeade203fb620f373479a4fd06.svg
paper_authors.fullname: LALIT PRADHAN
paper_authors.type: user
paper_authors.user: lalitpradhan
paper_authors._id: 64f0080606fd497b26170ed5
paper_authors.name: Zain Muhammad Mujahid
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-08-31T12:23:02.077Z
paper_authors._id: 637e8b1b66ee00bcb2468ed0
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/1669240174964-637e8b1b66ee00bcb2468ed0.jpeg
paper_authors.fullname: Zain
paper_authors.type: user
paper_authors.user: zainmujahid
paper_authors._id: 64f0080606fd497b26170ed6
paper_authors.name: Massa Baali
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-08-31T12:23:17.189Z
paper_authors._id: 64eddc2f79845a94dd791ebc
paper_authors.avatarUrl: /avatars/def0dcf448380873fc29de330b03131f.svg
paper_authors.fullname: Massa Baali
paper_authors.type: user
paper_authors.user: massabaali
paper_authors._id: 64f0080606fd497b26170ed7
paper_authors.name: Alham Fikri Aji
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-08-31T12:23:46.933Z
paper_authors._id: 61a4dc053205e107691e0d82
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/61a4dc053205e107691e0d82/BESoEHlHYXstXudh6dOdT.jpeg
paper_authors.fullname: Alham Fikri Aji
paper_authors.type: user
paper_authors.user: afaji
paper_authors._id: 64f0080606fd497b26170ed8
paper_authors.name: Zhengzhong Liu
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-11-27T01:29:05.092Z
paper_authors._id: 62fbdc67c776fd8821ae3f2d
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/62fbdc67c776fd8821ae3f2d/cI7iAZOL40RUYluo5ZVTU.png
paper_authors.fullname: Zhengzhong Liu
paper_authors.type: user
paper_authors.user: hunterhector
paper_authors._id: 64f0080606fd497b26170ed9
paper_authors.name: Andy Hock
paper_authors._id: 64f0080606fd497b26170eda
paper_authors.name: Andrew Feldman
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-08-31T12:24:17.683Z
paper_authors._id: 629f97653fa7e9d614e91036
paper_authors.avatarUrl: /avatars/1df315b950860ca536d551845e758e85.svg
paper_authors.fullname: Andrew Feldman
paper_authors.type: user
paper_authors.user: afeldman
paper_authors._id: 64f0080606fd497b26170edb
paper_authors.name: Jonathan Lee
paper_authors._id: 64f0080606fd497b26170edc
paper_authors.name: Andrew Jackson
paper_authors._id: 64f0080606fd497b26170edd
paper_authors.name: Preslav Nakov
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-08-31T12:25:08.061Z
paper_authors._id: 647f7eb25e1bc4753746bf9f
paper_authors.avatarUrl: /avatars/cc9c6210fdc822d8a106937e747dff41.svg
paper_authors.fullname: Preslav Nakov
paper_authors.type: user
paper_authors.user: preslavnakov
paper_authors._id: 64f0080606fd497b26170ede
paper_authors.name: Timothy Baldwin
paper_authors._id: 64f0080606fd497b26170edf
paper_authors.name: Eric Xing
paper_title: Jais and Jais-chat: Arabic-Centric Foundation and Instruction-Tuned Open
    Generative Large Language Models
paper_summary: We introduce Jais and Jais-chat, new state-of-the-art Arabic-centric
  foundation and instruction-tuned open generative large language models (LLMs).
  The models are based on the GPT-3 decoder-only architecture and are pretrained
  on a mixture of Arabic and English texts, including source code in various
  programming languages. With 13 billion parameters, they demonstrate better
  knowledge and reasoning capabilities in Arabic than any existing open Arabic
  and multilingual models by a sizable margin, based on extensive evaluation.
  Moreover, the models are competitive in English compared to English-centric
  open models of similar size, despite being trained on much less English data.
  We provide a detailed description of the training, the tuning, the safety
  alignment, and the evaluation of the models. We release two open versions of
  the model -- the foundation Jais model, and an instruction-tuned Jais-chat
  variant -- with the aim of promoting research on Arabic LLMs. Available at
  https://huggingface.co/inception-mbzuai/jais-13b-chat
paper_ai_keywords: GPT-3 decoder-only architecture pretrained Arabic English source code parameters knowledge reasoning capabilities multilingual evaluation instruction-tuned safety alignment Jais Jais-chat open versions Arabic LLMs