title: RakutenAI-7B: Extending Large Language Models for Japanese
summary: We introduce RakutenAI-7B, a suite of Japanese-oriented large language models
  that achieve the best performance on the Japanese LM Harness benchmarks among
  the open 7B models. Along with the foundation model, we release instruction-
  and chat-tuned models, RakutenAI-7B-instruct and RakutenAI-7B-chat
  respectively, under the Apache 2.0 license.
paper_authors._id: 66024db4259dac9a6930682c
paper_authors.name: Rakuten Group
paper_authors._id: 66024db4259dac9a6930682d
paper_authors.name: Aaron Levine
paper_authors._id: 66024db4259dac9a6930682e
paper_authors.name: Connie Huang
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-26T09:41:15.475Z
paper_authors._id: 641f7c8ff8c8b04c0bac138c
paper_authors.avatarUrl: /avatars/a24cf721acd270e4c750b8644d891016.svg
paper_authors.fullname: Connie Huang
paper_authors.type: user
paper_authors.user: conniehuang
paper_authors._id: 66024db4259dac9a6930682f
paper_authors.name: Chenguang Wang
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-26T09:41:32.341Z
paper_authors._id: 65e01784766434cd34e96256
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/65e01784766434cd34e96256/7jlKgKvvycap9HJgHK3-o.png
paper_authors.fullname: Chenguang Wang
paper_authors.type: user
paper_authors.user: chenguang-wang
paper_authors._id: 66024db4259dac9a69306830
paper_authors.name: Eduardo Batista
paper_authors._id: 66024db4259dac9a69306831
paper_authors.name: Ewa Szymanska
paper_authors._id: 66024db4259dac9a69306832
paper_authors.name: Hongyi Ding
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-26T09:42:03.905Z
paper_authors._id: 65e01838960938e63e4e81d0
paper_authors.avatarUrl: /avatars/767607c34c6a2fbc2dbc820a4b7a62a4.svg
paper_authors.fullname: Hongyi Ding
paper_authors.type: user
paper_authors.user: hongyiding
paper_authors._id: 66024db4259dac9a69306833
paper_authors.name: Hou Wei Chou
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-26T09:42:11.048Z
paper_authors._id: 63cf01c9c1dedf59c8f4f34b
paper_authors.avatarUrl: /avatars/c1eb264455d461a1f9fb1c54dbbb7dda.svg
paper_authors.fullname: Hou Wei Chou
paper_authors.type: user
paper_authors.user: houwei-chou
paper_authors._id: 66024db4259dac9a69306834
paper_authors.name: Jean-François Pessiot
paper_authors._id: 66024db4259dac9a69306835
paper_authors.name: Johanes Effendi
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-26T09:42:22.689Z
paper_authors._id: 63bd2ddc106236e1c1516e40
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/63bd2ddc106236e1c1516e40/NsgVBQvckBsKpYBu03KNc.jpeg
paper_authors.fullname: Johanes Effendi
paper_authors.type: user
paper_authors.user: effendietal
paper_authors._id: 66024db4259dac9a69306836
paper_authors.name: Justin Chiu
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-26T09:42:37.198Z
paper_authors._id: 650877773449d9a49ce4f2e3
paper_authors.avatarUrl: /avatars/7062c193ed632303eb2d0dd658f6f690.svg
paper_authors.fullname: Justin Chiu
paper_authors.type: user
paper_authors.user: justin-chiu-rakuten
paper_authors._id: 66024db4259dac9a69306837
paper_authors.name: Kai Torben Ohlhus
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-03-26T09:12:05.114Z
paper_authors._id: 648014263db1c8201e0117c1
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/648014263db1c8201e0117c1/2FdYPZUSS-M_1RMAGnzBZ.jpeg
paper_authors.fullname: Kai Torben Ohlhus
paper_authors.type: user
paper_authors.user: siko1056
paper_authors._id: 66024db4259dac9a69306838
paper_authors.name: Karan Chopra
paper_authors._id: 66024db4259dac9a69306839
paper_authors.name: Keiji Shinzato
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-26T09:43:01.291Z
paper_authors._id: 65e0bca2c2cf5ec0d0a3f6d9
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/65e0bca2c2cf5ec0d0a3f6d9/dgO-kUgZT7mWVMRrgnXlt.png
paper_authors.fullname: Keiji Shinzato
paper_authors.type: user
paper_authors.user: keiji-shinzato
paper_authors._id: 66024db4259dac9a6930683a
paper_authors.name: Koji Murakami
paper_authors._id: 66024db4259dac9a6930683b
paper_authors.name: Lee Xiong
paper_authors._id: 66024db4259dac9a6930683c
paper_authors.name: Lei Chen
paper_authors._id: 66024db4259dac9a6930683d
paper_authors.name: Maki Kubota
paper_authors._id: 66024db4259dac9a6930683e
paper_authors.name: Maksim Tkachenko
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-03-27T08:46:31.238Z
paper_authors._id: 65e021ef7d733a4dc7f5da56
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/65e021ef7d733a4dc7f5da56/J-3pPst0OxtKqu1B5DHqz.png
paper_authors.fullname: Maksim Tkachenko
paper_authors.type: user
paper_authors.user: maksim-tkachenko
paper_authors._id: 66024db4259dac9a6930683f
paper_authors.name: Miroku Lee
paper_authors._id: 66024db4259dac9a69306840
paper_authors.name: Naoki Takahashi
paper_authors._id: 66024db4259dac9a69306841
paper_authors.name: Prathyusha Jwalapuram
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-26T10:06:54.621Z
paper_authors._id: 65041640453165de0b9277a9
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/65041640453165de0b9277a9/uNLRUmmVGI_bKM3aF2bQg.jpeg
paper_authors.fullname: Prathyusha Jwalapuram
paper_authors.type: user
paper_authors.user: p-jwalapuram
paper_authors._id: 66024db4259dac9a69306842
paper_authors.name: Ryutaro Tatsushima
paper_authors._id: 66024db4259dac9a69306843
paper_authors.name: Saurabh Jain
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-04-03T09:15:01.804Z
paper_authors._id: 61614a852bae832775ff27ad
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/61614a852bae832775ff27ad/jYbbgccZWYsohmGNPEPBN.jpeg
paper_authors.fullname: Saurabh Jain
paper_authors.type: user
paper_authors.user: saurabhhssaurabh
paper_authors._id: 66024db4259dac9a69306844
paper_authors.name: Sunil Kumar Yadav
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-03-26T10:00:28.629Z
paper_authors._id: 60375bc433b7b6f8f2e67492
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/60375bc433b7b6f8f2e67492/25mbB0MwYkRchD_0Wf7Ei.jpeg
paper_authors.fullname: Sunil Kumar Yadav
paper_authors.type: user
paper_authors.user: sukuya
paper_authors._id: 66024db4259dac9a69306845
paper_authors.name: Ting Cai
paper_authors._id: 66024db4259dac9a69306846
paper_authors.name: Wei-Te Chen
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-26T10:05:06.006Z
paper_authors._id: 63f52269fcf95ecac2af31b3
paper_authors.avatarUrl: /avatars/25177bcedb66e0b421f77de0c33c9835.svg
paper_authors.fullname: Wei-Te Chen
paper_authors.type: user
paper_authors.user: weitechen
paper_authors._id: 66024db4259dac9a69306847
paper_authors.name: Yandi Xia
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-26T10:04:57.493Z
paper_authors._id: 64d138304a204a4d1249f1f3
paper_authors.avatarUrl: /avatars/0d2546e92ec5891921f18863347933f7.svg
paper_authors.fullname: Xia
paper_authors.type: user
paper_authors.user: Yandi89
paper_authors._id: 66024db4259dac9a69306848
paper_authors.name: Yuki Nakayama
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-26T10:00:50.503Z
paper_authors._id: 65f948aed6e1daae200c6b2a
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/65f948aed6e1daae200c6b2a/-7iyg06YFtAgf2Fcjrv9Q.jpeg
paper_authors.fullname: Yuki Nakayama
paper_authors.type: user
paper_authors.user: nayuukinni
paper_authors._id: 66024db4259dac9a69306849
paper_authors.name: Yutaka Higashiyama
paper_title: RakutenAI-7B: Extending Large Language Models for Japanese
paper_summary: We introduce RakutenAI-7B, a suite of Japanese-oriented large language models
  that achieve the best performance on the Japanese LM Harness benchmarks among
  the open 7B models. Along with the foundation model, we release instruction-
  and chat-tuned models, RakutenAI-7B-instruct and RakutenAI-7B-chat
  respectively, under the Apache 2.0 license.
paper_ai_summary: A suite of Japanese-oriented language models achieve top performance on open benchmarks, with variations for instructions and chat.
paper_ai_keywords: large language models Japanese LM Harness benchmarks instruction-tuned chat-tuned Apache 2.0 license