DeepSeek-Coder: When the Large Language Model Meets Programming -- The
  Rise of Code Intelligence
The rapid development of large language models has revolutionized code
intelligence in software development. However, the predominance of
closed-source models has restricted extensive research and development. To
address this, we introduce the DeepSeek-Coder series, a range of open-source
code models with sizes from 1.3B to 33B, trained from scratch on 2 trillion
tokens. These models are pre-trained on a high-quality project-level code
corpus and employ a fill-in-the-blank task with a 16K window to enhance code
generation and infilling. Our extensive evaluations demonstrate that
DeepSeek-Coder not only achieves state-of-the-art performance among open-source
code models across multiple benchmarks but also surpasses existing
closed-source models like Codex and GPT-3.5. Furthermore, DeepSeek-Coder models
are under a permissive license that allows for both research and unrestricted
commercial use.
65b32177b0a5a381b60c4e11
Daya Guo
admin_assigned
2024-01-26T09:38:34.569Z
653df20eaa1f487614da4db1
/avatars/12b27ce2c59f53b7e464039deab36a5d.svg
Daya Guo
user
guoday
65b32177b0a5a381b60c4e12
Qihao Zhu
admin_assigned
2024-01-26T09:38:47.601Z
63cd76b4374057a338e8e703
https://cdn-avatars.huggingface.co/v1/production/uploads/63cd76b4374057a338e8e703/i4Qk5-0aYx3oRhC8b50aJ.jpeg
zhuqihao
user
zqh11
65b32177b0a5a381b60c4e13
Dejian Yang
admin_assigned
2024-01-26T09:39:04.053Z
6225bb44c6e650de3a65dbaa
/avatars/99c99ced2461978df572c27c1b3a4904.svg
DejianYang
user
DejianYang
65b32177b0a5a381b60c4e14
Zhenda Xie
admin_assigned
2024-01-26T09:39:10.898Z
6539f6ea26df26ecd1393c37
https://cdn-avatars.huggingface.co/v1/production/uploads/6539f6ea26df26ecd1393c37/9VJusLLAiLhUxfBAFggpF.jpeg
Zhenda Xie
user
zdaxie
65b32177b0a5a381b60c4e15
Kai Dong
65b32177b0a5a381b60c4e16
Wentao Zhang
65b32177b0a5a381b60c4e17
Guanting Chen
65b32177b0a5a381b60c4e18
Xiao Bi
65b32177b0a5a381b60c4e19
Y. Wu
admin_assigned
2024-01-26T09:40:38.084Z
64d8aa52bcab729cb4e7973f
/avatars/d9f8118839e8ad3ec86ecd40cf59772f.svg
Y. WU
user
y-wu-pkutech
65b32177b0a5a381b60c4e1a
Y. K. Li
65b32177b0a5a381b60c4e1b
Fuli Luo
admin_assigned
2024-01-26T09:40:53.712Z
6538815d1bdb3c40db94fbfa
https://cdn-avatars.huggingface.co/v1/production/uploads/6538815d1bdb3c40db94fbfa/id7aSY8JUgKK2agKWLERt.jpeg
Fuli Luo
user
luofuli
65b32177b0a5a381b60c4e1c
Yingfei Xiong
65b32177b0a5a381b60c4e1d
Wenfeng Liang
DeepSeek-Coder: When the Large Language Model Meets Programming -- The
  Rise of Code Intelligence
The rapid development of large language models has revolutionized code
intelligence in software development. However, the predominance of
closed-source models has restricted extensive research and development. To
address this, we introduce the DeepSeek-Coder series, a range of open-source
code models with sizes from 1.3B to 33B, trained from scratch on 2 trillion
tokens. These models are pre-trained on a high-quality project-level code
corpus and employ a fill-in-the-blank task with a 16K window to enhance code
generation and infilling. Our extensive evaluations demonstrate that
DeepSeek-Coder not only achieves state-of-the-art performance among open-source
code models across multiple benchmarks but also surpasses existing
closed-source models like Codex and GPT-3.5. Furthermore, DeepSeek-Coder models
are under a permissive license that allows for both research and unrestricted
commercial use.
DeepSeek-Coder, a series of open-source code models trained from scratch, outperforms both open-source and closed-source models across multiple benchmarks.
DeepSeek-Coder large language models code generation infilling pre-trained fill-in-the-blank task project-level code corpus