title: LLM-jp: A Cross-organizational Project for the Research and Development
    of Fully Open Japanese LLMs
summary: This paper introduces LLM-jp, a cross-organizational project for the research
  and development of Japanese large language models (LLMs). LLM-jp aims to
  develop open-source and strong Japanese LLMs, and as of this writing, more than
  1,500 participants from academia and industry are working together for this
  purpose. This paper presents the background of the establishment of LLM-jp,
  summaries of its activities, and technical reports on the LLMs developed by
  LLM-jp. For the latest activities, visit https://llm-jp.nii.ac.jp/en/.
paper_authors._id: 668b603f35da6da695980a87
paper_authors.name: LLM-jp
paper_authors._id: 668b603f35da6da695980a89
paper_authors.name: Akiko Aizawa
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-08T21:23:22.555Z
paper_authors._id: 63426285e5071b0c5cd623c4
paper_authors.avatarUrl: /avatars/de2fe0d41f4d83721bc684825ca50483.svg
paper_authors.fullname: Akiko Aizawa
paper_authors.type: user
paper_authors.user: aizaki
paper_authors._id: 668b603f35da6da695980a8a
paper_authors.name: Eiji Aramaki
paper_authors._id: 668b603f35da6da695980a8b
paper_authors.name: Bowen Chen
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-09T07:41:28.753Z
paper_authors._id: 64b988b965be45c7766b105a
paper_authors.avatarUrl: /avatars/ef1944c79cfe851d079dcba0603526ab.svg
paper_authors.fullname: Bowen Chen
paper_authors.type: user
paper_authors.user: bowen118
paper_authors._id: 668b603f35da6da695980a8c
paper_authors.name: Fei Cheng
paper_authors._id: 668b603f35da6da695980a8d
paper_authors.name: Hiroyuki Deguchi
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-08T21:23:40.761Z
paper_authors._id: 6582a924117b524ef3fb3068
paper_authors.avatarUrl: /avatars/b30b28a835b61eff03d0e09336cb8418.svg
paper_authors.fullname: Hiroyuki Deguchi
paper_authors.type: user
paper_authors.user: hdeguchi
paper_authors._id: 668b603f35da6da695980a8e
paper_authors.name: Rintaro Enomoto
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-08T21:23:47.506Z
paper_authors._id: 64933ac0e110d73cd7cb68da
paper_authors.avatarUrl: /avatars/a368523b4d941add1a9010cc5b8aba03.svg
paper_authors.fullname: Rintaro Enomoto
paper_authors.type: user
paper_authors.user: ununtrium
paper_authors._id: 668b603f35da6da695980a8f
paper_authors.name: Kazuki Fujii
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-22T09:32:10.779Z
paper_authors._id: 6409e25c9989bcb11720c7a5
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/6409e25c9989bcb11720c7a5/s1ORf9TZRHOp-MzAfp6Ax.jpeg
paper_authors.fullname: Kazuki Fujii
paper_authors.type: user
paper_authors.user: kazukifujii
paper_authors._id: 668b603f35da6da695980a90
paper_authors.name: Kensuke Fukumoto
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-08T21:24:01.881Z
paper_authors._id: 632463dda831987cc7367a36
paper_authors.avatarUrl: /avatars/dde7f04b09c415803653e3fbfd271360.svg
paper_authors.fullname: Kensuke Fukumoto
paper_authors.type: user
paper_authors.user: Fooken
paper_authors._id: 668b603f35da6da695980a91
paper_authors.name: Takuya Fukushima
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-08T21:24:07.983Z
paper_authors._id: 630706ae660f01f150aa4f66
paper_authors.avatarUrl: /avatars/54dad809ee0bec7215ed0d0eecbf34cf.svg
paper_authors.fullname: Takuya Fukushima
paper_authors.type: user
paper_authors.user: Fta98
paper_authors._id: 668b603f35da6da695980a92
paper_authors.name: Namgi Han
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-08T21:24:15.922Z
paper_authors._id: 651170a65bfdbe32f9f934a8
paper_authors.avatarUrl: /avatars/d6f9a5c683ad793e4b4f9f9cdc5aa2b9.svg
paper_authors.fullname: Namgi Han
paper_authors.type: user
paper_authors.user: namgiH
paper_authors._id: 668b603f35da6da695980a93
paper_authors.name: Yuto Harada
paper_authors._id: 668b603f35da6da695980a94
paper_authors.name: Chikara Hashimoto
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-08T21:24:26.124Z
paper_authors._id: 605d14e5f7f3d2820bb005e8
paper_authors.avatarUrl: /avatars/1b145748a6606a0d5c8ff66dbdf052cf.svg
paper_authors.fullname: Chikara Hashimoto
paper_authors.type: user
paper_authors.user: Chikara
paper_authors._id: 668b603f35da6da695980a95
paper_authors.name: Tatsuya Hiraoka
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-08T21:24:43.489Z
paper_authors._id: 655c1f5483186f133f99a3cd
paper_authors.avatarUrl: /avatars/bbfe3729fa2736c4e5775149428b936f.svg
paper_authors.fullname: tatsuya hiraoka
paper_authors.type: user
paper_authors.user: tathi
paper_authors._id: 668b603f35da6da695980a96
paper_authors.name: Shohei Hisada
paper_authors._id: 668b603f35da6da695980a97
paper_authors.name: Sosuke Hosokawa
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-08T21:46:00.224Z
paper_authors._id: 63cb19109f78909f9f83a376
paper_authors.avatarUrl: /avatars/d2bd7cdfff51eef913bc48e5de77ca76.svg
paper_authors.fullname: Sosuke Hosokawa
paper_authors.type: user
paper_authors.user: so298
paper_authors._id: 668b603f35da6da695980a98
paper_authors.name: Lu Jie
paper_authors._id: 668b603f35da6da695980a99
paper_authors.name: Keisuke Kamata
paper_authors._id: 668b603f35da6da695980a9a
paper_authors.name: Teruhito Kanazawa
paper_authors._id: 668b603f35da6da695980a9b
paper_authors.name: Hiroki Kanezashi
paper_authors._id: 668b603f35da6da695980a9c
paper_authors.name: Hiroshi Kataoka
paper_authors._id: 668b603f35da6da695980a9d
paper_authors.name: Satoru Katsumata
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-08T21:46:23.029Z
paper_authors._id: 63c94df351b03e8e01b2a692
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/63c94df351b03e8e01b2a692/nAIPkCC-sgsnOIDIwqYsL.jpeg
paper_authors.fullname: Satoru Katsumata
paper_authors.type: user
paper_authors.user: Katsumata420
paper_authors._id: 668b603f35da6da695980a9e
paper_authors.name: Daisuke Kawahara
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-08T21:46:29.368Z
paper_authors._id: 61c00f0ac88f3fd22f6540a8
paper_authors.avatarUrl: /avatars/d48e57561b9b04ac18c576decd0cfbb8.svg
paper_authors.fullname: Daisuke Kawahara
paper_authors.type: user
paper_authors.user: dkawahara
paper_authors._id: 668b603f35da6da695980a9f
paper_authors.name: Seiya Kawano
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-08T21:46:37.040Z
paper_authors._id: 6417ccd4f1e86908935ee82b
paper_authors.avatarUrl: /avatars/f8ec49c08d09e3c28e6d83f6fd8a94b3.svg
paper_authors.fullname: Seiya Kawano
paper_authors.type: user
paper_authors.user: kwnsiy
paper_authors._id: 668b603f35da6da695980aa0
paper_authors.name: Atsushi Keyaki
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-08T21:46:44.433Z
paper_authors._id: 6525e847b8ef9275b8164a87
paper_authors.avatarUrl: /avatars/b773daeab435018f26c39bb4e964804a.svg
paper_authors.fullname: Atsushi Keyaki
paper_authors.type: user
paper_authors.user: keyakkie
paper_authors._id: 668b603f35da6da695980aa1
paper_authors.name: Keisuke Kiryu
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-08T21:46:52.030Z
paper_authors._id: 64b0b58666a078bc7bff4df2
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/64b0b58666a078bc7bff4df2/XqlHKm-MOvtFPSvKqn5cE.jpeg
paper_authors.fullname: Keisuke Kiryu
paper_authors.type: user
paper_authors.user: analogtechnica
paper_authors._id: 668b603f35da6da695980aa2
paper_authors.name: Hirokazu Kiyomaru
paper_authors._id: 668b603f35da6da695980aa3
paper_authors.name: Takashi Kodama
paper_authors._id: 668b603f35da6da695980aa4
paper_authors.name: Takahiro Kubo
paper_authors._id: 668b603f35da6da695980aa5
paper_authors.name: Yohei Kuga
paper_authors._id: 668b603f35da6da695980aa6
paper_authors.name: Ryoma Kumon
paper_authors._id: 668b603f35da6da695980aa7
paper_authors.name: Shuhei Kurita
paper_authors._id: 668b603f35da6da695980aa8
paper_authors.name: Sadao Kurohashi
paper_authors._id: 668b603f35da6da695980aa9
paper_authors.name: Conglong Li
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-07-10T08:20:01.749Z
paper_authors._id: 617adc6d941993035fbaf2b3
paper_authors.avatarUrl: /avatars/8de7dc3a6e202a49ac9c061e93d0fc92.svg
paper_authors.fullname: Conglong Li
paper_authors.type: user
paper_authors.user: conglongli
paper_authors._id: 668b603f35da6da695980aaa
paper_authors.name: Taiki Maekawa
paper_authors._id: 668b603f35da6da695980aab
paper_authors.name: Hiroshi Matsuda
paper_authors._id: 668b603f35da6da695980aac
paper_authors.name: Yusuke Miyao
paper_authors._id: 668b603f35da6da695980aad
paper_authors.name: Kentaro Mizuki
paper_authors._id: 668b603f35da6da695980aae
paper_authors.name: Sakae Mizuki
paper_authors._id: 668b603f35da6da695980aaf
paper_authors.name: Yugo Murawaki
paper_authors._id: 668b603f35da6da695980ab0
paper_authors.name: Ryo Nakamura
paper_authors._id: 668b603f35da6da695980ab1
paper_authors.name: Taishi Nakamura
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-07-09T21:09:16.029Z
paper_authors._id: 6308c49c454dc257521bc7f9
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/6308c49c454dc257521bc7f9/UWUS6OPa6OpVu1T0gd-wJ.jpeg
paper_authors.fullname: Taishi
paper_authors.type: user
paper_authors.user: Taishi-N324
paper_authors._id: 668b603f35da6da695980ab2
paper_authors.name: Kouta Nakayama
paper_authors._id: 668b603f35da6da695980ab3
paper_authors.name: Tomoka Nakazato
paper_authors._id: 668b603f35da6da695980ab4
paper_authors.name: Takuro Niitsuma
paper_authors._id: 668b603f35da6da695980ab5
paper_authors.name: Jiro Nishitoba
paper_authors._id: 668b603f35da6da695980ab6
paper_authors.name: Yusuke Oda
paper_authors._id: 668b603f35da6da695980ab7
paper_authors.name: Hayato Ogawa
paper_authors._id: 668b603f35da6da695980ab8
paper_authors.name: Takumi Okamoto
paper_authors._id: 668b603f35da6da695980ab9
paper_authors.name: Naoaki Okazaki
paper_authors._id: 668b603f35da6da695980aba
paper_authors.name: Yohei Oseki
paper_authors._id: 668b603f35da6da695980abb
paper_authors.name: Shintaro Ozaki
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-07-22T08:43:37.785Z
paper_authors._id: 633fd25809f89260f076638d
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/633fd25809f89260f076638d/oZAFUSkH2rt-KjYhbAKKu.jpeg
paper_authors.fullname: Shintaro Ozaki
paper_authors.type: user
paper_authors.user: shintaro-ozaki
paper_authors._id: 668b603f35da6da695980abc
paper_authors.name: Koki Ryu
paper_authors._id: 668b603f35da6da695980abd
paper_authors.name: Rafal Rzepka
paper_authors._id: 668b603f35da6da695980abe
paper_authors.name: Keisuke Sakaguchi
paper_authors._id: 668b603f35da6da695980abf
paper_authors.name: Shota Sasaki
paper_authors._id: 668b603f35da6da695980ac0
paper_authors.name: Satoshi Sekine
paper_authors._id: 668b603f35da6da695980ac1
paper_authors.name: Kohei Suda
paper_authors._id: 668b603f35da6da695980ac2
paper_authors.name: Saku Sugawara
paper_authors._id: 668b603f35da6da695980ac3
paper_authors.name: Issa Sugiura
paper_authors._id: 668b603f35da6da695980ac4
paper_authors.name: Hiroaki Sugiyama
paper_authors._id: 668b603f35da6da695980ac5
paper_authors.name: Hisami Suzuki
paper_authors._id: 668b603f35da6da695980ac6
paper_authors.name: Jun Suzuki
paper_authors._id: 668b603f35da6da695980ac7
paper_authors.name: Toyotaro Suzumura
paper_authors._id: 668b603f35da6da695980ac8
paper_authors.name: Kensuke Tachibana
paper_authors._id: 668b603f35da6da695980ac9
paper_authors.name: Yu Takagi
paper_authors._id: 668b603f35da6da695980aca
paper_authors.name: Kyosuke Takami
paper_authors._id: 668b603f35da6da695980acb
paper_authors.name: Koichi Takeda
paper_authors._id: 668b603f35da6da695980acc
paper_authors.name: Masashi Takeshita
paper_authors._id: 668b603f35da6da695980acd
paper_authors.name: Masahiro Tanaka
paper_authors._id: 668b603f35da6da695980ace
paper_authors.name: Kenjiro Taura
paper_authors._id: 668b603f35da6da695980acf
paper_authors.name: Arseny Tolmachev
paper_authors._id: 668b603f35da6da695980ad0
paper_authors.name: Nobuhiro Ueda
paper_authors._id: 668b603f35da6da695980ad1
paper_authors.name: Zhen Wan
paper_authors._id: 668b603f35da6da695980ad2
paper_authors.name: Shuntaro Yada
paper_authors._id: 668b603f35da6da695980ad3
paper_authors.name: Sakiko Yahata
paper_authors._id: 668b603f35da6da695980ad4
paper_authors.name: Yuya Yamamoto
paper_authors._id: 668b603f35da6da695980ad5
paper_authors.name: Yusuke Yamauchi
paper_authors._id: 668b603f35da6da695980ad6
paper_authors.name: Hitomi Yanaka
paper_authors._id: 668b603f35da6da695980ad7
paper_authors.name: Rio Yokota
paper_authors._id: 668b603f35da6da695980ad8
paper_authors.name: Koichiro Yoshino
paper_title: LLM-jp: A Cross-organizational Project for the Research and Development
    of Fully Open Japanese LLMs
paper_summary: This paper introduces LLM-jp, a cross-organizational project for the research
  and development of Japanese large language models (LLMs). LLM-jp aims to
  develop open-source and strong Japanese LLMs, and as of this writing, more than
  1,500 participants from academia and industry are working together for this
  purpose. This paper presents the background of the establishment of LLM-jp,
  summaries of its activities, and technical reports on the LLMs developed by
  LLM-jp. For the latest activities, visit https://llm-jp.nii.ac.jp/en/.