RakutenAI-7B: Extending Large Language Models for Japanese
<|reference_start|>RakutenAI-7B: Extending Large Language Models for Japanese: We introduce RakutenAI-7B, a suite of Japanese-oriented large language models that achieve the best performance on the Japanese LM Harness benchmarks among the open 7B models. Along with the foundation model, we release instruction- and chat-tuned models, RakutenAI-7B-instruct and RakutenAI-7B-chat respectively, under the Apache 2.0 license.<|reference_end|>
@article{rakuten group2024rakutenai-7b:,
    title={RakutenAI-7B: Extending Large Language Models for Japanese},
    author={Rakuten Group Inc., Aaron Levine, Connie Huang, Chenguang Wang,
  Eduardo Batista, Ewa Szymanska, Hongyi Ding, Hou Wei Chou, Jean-Franc{c}ois
  Pessiot, Johanes Effendi, Justin Chiu, Kai Torben Ohlhus, Karan Chopra, Keiji
  Shinzato, Koji Murakami, Lee Xiong, Lei Chen, Maki Kubota, Maksim Tkachenko,
  Miroku Lee, Naoki Takahashi, Prathyusha Jwalapuram, Ryutaro Tatsushima,
  Saurabh Jain, Sunil Kumar Yadav, Ting Cai, Wei-Te Chen, Yandi Xia, Yuki
  Nakayama, Yutaka Higashiyama},
    journal={arXiv preprint arXiv:2403.15484},
    year={2024},
    archivePrefix={arXiv},
    eprint={2403.15484},
    primaryClass={cs.CL cs.LG}
}