title: Nemotron-4 15B Technical Report
summary: We introduce Nemotron-4 15B, a 15-billion-parameter large multilingual
  language model trained on 8 trillion text tokens. Nemotron-4 15B demonstrates
  strong performance when assessed on English, multilingual, and coding tasks: it
  outperforms all existing similarly-sized open models on 4 out of 7 downstream
  evaluation areas and achieves competitive performance to the leading open
  models in the remaining ones. Specifically, Nemotron-4 15B exhibits the best
  multilingual capabilities of all similarly-sized models, even outperforming
  models over four times larger and those explicitly specialized for multilingual
  tasks.
paper_authors._id: 65dd6be65012ec503f1bae87
paper_authors.name: Jupinder Parmar
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-02-27T10:38:03.076Z
paper_authors._id: 63d2f8182727d7888cba3c93
paper_authors.avatarUrl: /avatars/fa46bab692fcf20b92270ec0fff3681a.svg
paper_authors.fullname: Jupinder Parmar
paper_authors.type: user
paper_authors.user: jupinderp
paper_authors._id: 65dd6be65012ec503f1bae88
paper_authors.name: Shrimai Prabhumoye
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-02-27T10:38:09.023Z
paper_authors._id: 6470efe7fa9fd77212e17a97
paper_authors.avatarUrl: /avatars/a116b279b927627eeee9c23021b6e5ee.svg
paper_authors.fullname: Shrimai Prabhumoye
paper_authors.type: user
paper_authors.user: shrimai
paper_authors._id: 65dd6be65012ec503f1bae89
paper_authors.name: Joseph Jennings
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-02-27T10:38:16.476Z
paper_authors._id: 645ad6e2d8ba048d02ad374a
paper_authors.avatarUrl: /avatars/461a871387bbc0b3e117fd17dfce5430.svg
paper_authors.fullname: Joseph Jennings
paper_authors.type: user
paper_authors.user: jojennin
paper_authors._id: 65dd6be65012ec503f1bae8a
paper_authors.name: Mostofa Patwary
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-02-27T10:38:23.518Z
paper_authors._id: 630544b09d2531fabd156fd3
paper_authors.avatarUrl: /avatars/7b5374244a887577834fb4524ff76d01.svg
paper_authors.fullname: Mostofa Patwary
paper_authors.type: user
paper_authors.user: mpatwary
paper_authors._id: 65dd6be65012ec503f1bae8b
paper_authors.name: Sandeep Subramanian
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-02-27T10:38:30.421Z
paper_authors._id: 627bf27cf19c5eb46d54cea8
paper_authors.avatarUrl: /avatars/b8ca0b4e841858c1d234671187234f56.svg
paper_authors.fullname: Sandeep Subramanian
paper_authors.type: user
paper_authors.user: MaximumEntropy
paper_authors._id: 65dd6be65012ec503f1bae8c
paper_authors.name: Dan Su
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-06-05T07:31:24.099Z
paper_authors._id: 67e34615c15564fd97f697ce
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/BNXjsEA5rGn7uFoFuVkB6.png
paper_authors.fullname: Dan Su
paper_authors.type: user
paper_authors.user: sudandandansu1
paper_authors._id: 65dd6be65012ec503f1bae8d
paper_authors.name: Chen Zhu
paper_authors._id: 65dd6be65012ec503f1bae8e
paper_authors.name: Deepak Narayanan
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-02-27T10:39:09.758Z
paper_authors._id: 617af1457ced0304d1b75b89
paper_authors.avatarUrl: /avatars/5fdf3b5d9b93af1a70c4a81eb18a8d19.svg
paper_authors.fullname: Deepak Narayanan
paper_authors.type: user
paper_authors.user: deepakn94
paper_authors._id: 65dd6be65012ec503f1bae8f
paper_authors.name: Aastha Jhunjhunwala
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-02-27T10:39:15.893Z
paper_authors._id: 63a1eeecf30c4642277e613e
paper_authors.avatarUrl: /avatars/50d0fc6f0ce80bb8905b28e4fbe8cadb.svg
paper_authors.fullname: Aastha Jhunjhunwala
paper_authors.type: user
paper_authors.user: aasthaj
paper_authors._id: 65dd6be65012ec503f1bae90
paper_authors.name: Ayush Dattagupta
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-02-27T10:39:22.510Z
paper_authors._id: 65cc27efa994380c82ca603c
paper_authors.avatarUrl: /avatars/651e2fbc272b1e8f8cd343c4c5ff6276.svg
paper_authors.fullname: Ayush Dattagupta
paper_authors.type: user
paper_authors.user: ayushdg95
paper_authors._id: 65dd6be65012ec503f1bae91
paper_authors.name: Vibhu Jawa
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-02-27T16:08:15.225Z
paper_authors._id: 646ac857086023e36edcc273
paper_authors.avatarUrl: /avatars/3b6e51d9ff311bb472be98d5cdc947da.svg
paper_authors.fullname: Vibhu Jawa
paper_authors.type: user
paper_authors.user: VibhuJawa
paper_authors._id: 65dd6be65012ec503f1bae92
paper_authors.name: Jiwei Liu
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-02-27T10:39:50.905Z
paper_authors._id: 627fbbe9b846ecb5f28e6d0c
paper_authors.avatarUrl: /avatars/733e198097cfa66c2300e471101735ff.svg
paper_authors.fullname: Jiwei Liu
paper_authors.type: user
paper_authors.user: daxiongshu
paper_authors._id: 65dd6be65012ec503f1bae93
paper_authors.name: Ameya Mahabaleshwarkar
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-02-27T10:40:06.314Z
paper_authors._id: 6362e35db64a5669426c4dfc
paper_authors.avatarUrl: /avatars/430eafb1a5951480f7edf5735d72709e.svg
paper_authors.fullname: Ameya Mahabaleshwarkar
paper_authors.type: user
paper_authors.user: amahabal
paper_authors._id: 65dd6be65012ec503f1bae94
paper_authors.name: Osvald Nitski
paper_authors._id: 65dd6be65012ec503f1bae95
paper_authors.name: Annika Brundyn
paper_authors._id: 65dd6be65012ec503f1bae96
paper_authors.name: James Maki
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-02-27T10:40:49.000Z
paper_authors._id: 6556621866423b57b2ce0552
paper_authors.avatarUrl: /avatars/de80b5d50ef4f84504ebc5f39c6bf147.svg
paper_authors.fullname: James Maki
paper_authors.type: user
paper_authors.user: jmaki
paper_authors._id: 65dd6be65012ec503f1bae97
paper_authors.name: Miguel Martinez
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-02-28T08:28:16.328Z
paper_authors._id: 61900ccbec759925a87f919b
paper_authors.avatarUrl: /avatars/1ba5b639fb871da839d6ad7db427755a.svg
paper_authors.fullname: Miguel
paper_authors.type: user
paper_authors.user: miguelusque
paper_authors._id: 65dd6be65012ec503f1bae98
paper_authors.name: Jiaxuan You
paper_authors._id: 65dd6be65012ec503f1bae99
paper_authors.name: John Kamalu
paper_authors._id: 65dd6be65012ec503f1bae9a
paper_authors.name: Patrick LeGresley
paper_authors._id: 65dd6be65012ec503f1bae9b
paper_authors.name: Denys Fridman
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-02-27T10:41:40.930Z
paper_authors._id: 64ff36132f27723840f0490d
paper_authors.avatarUrl: /avatars/e2b559c81b1892a0e61aae5b9d08133c.svg
paper_authors.fullname: Denys Fridman
paper_authors.type: user
paper_authors.user: dfridman
paper_authors._id: 65dd6be65012ec503f1bae9c
paper_authors.name: Jared Casper
paper_authors._id: 65dd6be65012ec503f1bae9d
paper_authors.name: Ashwath Aithal
paper_authors._id: 65dd6be65012ec503f1bae9e
paper_authors.name: Oleksii Kuchaiev
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-02-27T10:41:55.083Z
paper_authors._id: 622937a4acd5bef90e55c49d
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/1649475932211-622937a4acd5bef90e55c49d.jpeg
paper_authors.fullname: Oleksii Kuchaiev
paper_authors.type: user
paper_authors.user: okuchaiev
paper_authors._id: 65dd6be65012ec503f1bae9f
paper_authors.name: Mohammad Shoeybi
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-05-28T07:19:41.371Z
paper_authors._id: 6641544c695975af2cbd0da6
paper_authors.avatarUrl: /avatars/0ad3c18dcba585259b064fe9b00a07ce.svg
paper_authors.fullname: Mohammad Shoeybi
paper_authors.type: user
paper_authors.user: shoeybi
paper_authors._id: 65dd6be65012ec503f1baea0
paper_authors.name: Jonathan Cohen
paper_authors._id: 65dd6be65012ec503f1baea1
paper_authors.name: Bryan Catanzaro
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-02-27T10:42:34.450Z
paper_authors._id: 6311021788942700629e6247
paper_authors.avatarUrl: /avatars/e7adc1632b76e80e7e4a590033d1c20a.svg
paper_authors.fullname: Bryan Catanzaro
paper_authors.type: user
paper_authors.user: ctnzr
paper_title: Nemotron-4 15B Technical Report
paper_summary: We introduce Nemotron-4 15B, a 15-billion-parameter large multilingual
  language model trained on 8 trillion text tokens. Nemotron-4 15B demonstrates
  strong performance when assessed on English, multilingual, and coding tasks: it
  outperforms all existing similarly-sized open models on 4 out of 7 downstream
  evaluation areas and achieves competitive performance to the leading open
  models in the remaining ones. Specifically, Nemotron-4 15B exhibits the best
  multilingual capabilities of all similarly-sized models, even outperforming
  models over four times larger and those explicitly specialized for multilingual
  tasks.
paper_ai_summary: Nemotron-4 15B, a large multilingual language model, excels in English, multilingual, and coding tasks, demonstrating superior performance in multilingual capabilities compared to larger and specialized models.
paper_ai_keywords: large multilingual language model downstream evaluation areas multilingual capabilities