title: DeepSeek-Coder: When the Large Language Model Meets Programming -- The
    Rise of Code Intelligence
summary: The rapid development of large language models has revolutionized code
  intelligence in software development. However, the predominance of
  closed-source models has restricted extensive research and development. To
  address this, we introduce the DeepSeek-Coder series, a range of open-source
  code models with sizes from 1.3B to 33B, trained from scratch on 2 trillion
  tokens. These models are pre-trained on a high-quality project-level code
  corpus and employ a fill-in-the-blank task with a 16K window to enhance code
  generation and infilling. Our extensive evaluations demonstrate that
  DeepSeek-Coder not only achieves state-of-the-art performance among open-source
  code models across multiple benchmarks but also surpasses existing
  closed-source models like Codex and GPT-3.5. Furthermore, DeepSeek-Coder models
  are under a permissive license that allows for both research and unrestricted
  commercial use.
paper_authors._id: 65b32177b0a5a381b60c4e11
paper_authors.name: Daya Guo
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-01-26T09:38:34.569Z
paper_authors._id: 653df20eaa1f487614da4db1
paper_authors.avatarUrl: /avatars/12b27ce2c59f53b7e464039deab36a5d.svg
paper_authors.fullname: Daya Guo
paper_authors.type: user
paper_authors.user: guoday
paper_authors._id: 65b32177b0a5a381b60c4e12
paper_authors.name: Qihao Zhu
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-01-26T09:38:47.601Z
paper_authors._id: 63cd76b4374057a338e8e703
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/63cd76b4374057a338e8e703/i4Qk5-0aYx3oRhC8b50aJ.jpeg
paper_authors.fullname: zhuqihao
paper_authors.type: user
paper_authors.user: zqh11
paper_authors._id: 65b32177b0a5a381b60c4e13
paper_authors.name: Dejian Yang
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-01-26T09:39:04.053Z
paper_authors._id: 6225bb44c6e650de3a65dbaa
paper_authors.avatarUrl: /avatars/99c99ced2461978df572c27c1b3a4904.svg
paper_authors.fullname: DejianYang
paper_authors.type: user
paper_authors.user: DejianYang
paper_authors._id: 65b32177b0a5a381b60c4e14
paper_authors.name: Zhenda Xie
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-01-26T09:39:10.898Z
paper_authors._id: 6539f6ea26df26ecd1393c37
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/6539f6ea26df26ecd1393c37/9VJusLLAiLhUxfBAFggpF.jpeg
paper_authors.fullname: Zhenda Xie
paper_authors.type: user
paper_authors.user: zdaxie
paper_authors._id: 65b32177b0a5a381b60c4e15
paper_authors.name: Kai Dong
paper_authors._id: 65b32177b0a5a381b60c4e16
paper_authors.name: Wentao Zhang
paper_authors._id: 65b32177b0a5a381b60c4e17
paper_authors.name: Guanting Chen
paper_authors._id: 65b32177b0a5a381b60c4e18
paper_authors.name: Xiao Bi
paper_authors._id: 65b32177b0a5a381b60c4e19
paper_authors.name: Y. Wu
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-01-26T09:40:38.084Z
paper_authors._id: 64d8aa52bcab729cb4e7973f
paper_authors.avatarUrl: /avatars/d9f8118839e8ad3ec86ecd40cf59772f.svg
paper_authors.fullname: Y. WU
paper_authors.type: user
paper_authors.user: y-wu-pkutech
paper_authors._id: 65b32177b0a5a381b60c4e1a
paper_authors.name: Y. K. Li
paper_authors._id: 65b32177b0a5a381b60c4e1b
paper_authors.name: Fuli Luo
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-01-26T09:40:53.712Z
paper_authors._id: 6538815d1bdb3c40db94fbfa
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/6538815d1bdb3c40db94fbfa/id7aSY8JUgKK2agKWLERt.jpeg
paper_authors.fullname: Fuli Luo
paper_authors.type: user
paper_authors.user: luofuli
paper_authors._id: 65b32177b0a5a381b60c4e1c
paper_authors.name: Yingfei Xiong
paper_authors._id: 65b32177b0a5a381b60c4e1d
paper_authors.name: Wenfeng Liang
paper_title: DeepSeek-Coder: When the Large Language Model Meets Programming -- The
    Rise of Code Intelligence
paper_summary: The rapid development of large language models has revolutionized code
  intelligence in software development. However, the predominance of
  closed-source models has restricted extensive research and development. To
  address this, we introduce the DeepSeek-Coder series, a range of open-source
  code models with sizes from 1.3B to 33B, trained from scratch on 2 trillion
  tokens. These models are pre-trained on a high-quality project-level code
  corpus and employ a fill-in-the-blank task with a 16K window to enhance code
  generation and infilling. Our extensive evaluations demonstrate that
  DeepSeek-Coder not only achieves state-of-the-art performance among open-source
  code models across multiple benchmarks but also surpasses existing
  closed-source models like Codex and GPT-3.5. Furthermore, DeepSeek-Coder models
  are under a permissive license that allows for both research and unrestricted
  commercial use.
paper_ai_keywords: large language models code intelligence deepseek-coder series fill-in-the-blank task code generation infilling high-quality project-level code corpus open-source code models closed-source models msex gpt-3.5 permissive license large language models code intelligence deepseek-coder series fill-in-the-blank task code generation infilling high-quality project-level code corpus open-source code models msex gpt-3.5 permissive license large language models code intelligence deepseek-coder series fill-in-the-blank task code generation infilling high-quality project-level code corpus open-source code models msex gpt-3.5 permissive license