Qwen Technical Report
Large language models (LLMs) have revolutionized the field of artificial
intelligence, enabling natural language processing tasks that were previously
thought to be exclusive to humans. In this work, we introduce Qwen, the first
installment of our large language model series. Qwen is a comprehensive
language model series that encompasses distinct models with varying parameter
counts. It includes Qwen, the base pretrained language models, and Qwen-Chat,
the chat models finetuned with human alignment techniques. The base language
models consistently demonstrate superior performance across a multitude of
downstream tasks, and the chat models, particularly those trained using
Reinforcement Learning from Human Feedback (RLHF), are highly competitive. The
chat models possess advanced tool-use and planning capabilities for creating
agent applications, showcasing impressive performance even when compared to
bigger models on complex tasks like utilizing a code interpreter. Furthermore,
we have developed coding-specialized models, Code-Qwen and Code-Qwen-Chat, as
well as mathematics-focused models, Math-Qwen-Chat, which are built upon base
language models. These models demonstrate significantly improved performance in
comparison with open-source models, and slightly fall behind the proprietary
models.
651630afbc063171987181c1
Jinze Bai
admin_assigned
2023-09-29T11:24:05.009Z
60113fad51e116b62cd0a30e
/avatars/469357d0a4a5d2e104ae5e32801b395d.svg
Jinze Bai
user
Jinze
651630afbc063171987181c2
Shuai Bai
admin_assigned
2023-09-29T11:24:28.046Z
63451cf0a05b51f7ded25505
/avatars/dec4bbee4a82b773fc58dfc2dce9dbeb.svg
shuai bai
user
bluelike
651630afbc063171987181c3
Yunfei Chu
admin_assigned
2023-09-29T11:24:35.652Z
62c6a751a71b40cf26f359a8
/avatars/49abd2e71946035452c316d703baaac6.svg
Yunfei Chu
user
faychu
651630afbc063171987181c4
Zeyu Cui
claimed_verified
2024-09-23T14:22:30.930Z
643fb14a18afbc4d1f3ebfb4
https://cdn-avatars.huggingface.co/v1/production/uploads/643fb14a18afbc4d1f3ebfb4/2qeL_qPSB9_MTzZf46ynJ.png
czy yente
user
cyente
651630afbc063171987181c5
Kai Dang
651630afbc063171987181c6
Xiaodong Deng
651630afbc063171987181c7
Yang Fan
651630afbc063171987181c8
Wenbin Ge
admin_assigned
2023-09-29T11:25:57.232Z
634d06c6f0a69955f662e641
/avatars/5a0af8af0a21d2a93192f4a3c430fc60.svg
Wenbin Ge
user
gewenbin292
651630afbc063171987181c9
Yu Han
651630afbc063171987181ca
Fei Huang
admin_assigned
2023-09-29T11:26:37.681Z
635b8b6a37c6a2c12e2cce00
/avatars/229fb72180529141515d1df797b33709.svg
Fei Huang
user
hzhwcmhf
651630afbc063171987181cb
Binyuan Hui
admin_assigned
2023-09-29T11:26:46.394Z
61e4c4ca1ab24785ac11ba69
https://cdn-avatars.huggingface.co/v1/production/uploads/61e4c4ca1ab24785ac11ba69/1Q1zhhyGSJ9RJG9MzwxVv.jpeg
Binyuan Hui
user
huybery
651630afbc063171987181cc
Luo Ji
651630afbc063171987181cd
Mei Li
651630afbc063171987181ce
Junyang Lin
admin_assigned
2023-09-29T11:27:03.767Z
620760a26e3b7210c2ff1943
https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/VC-rKqimF6yxGESNVlPoR.jpeg
Junyang Lin
user
JustinLin610
651630afbc063171987181cf
Runji Lin
claimed_verified
2024-12-10T11:18:06.766Z
649a52e5de0fb7f3f499e583
/avatars/25f6106fa168ae57ad5cd8ef55c70d31.svg
Runji Lin
user
RunjiLin
651630afbc063171987181d0
Dayiheng Liu
admin_assigned
2023-09-29T11:27:21.332Z
6434d4989bd5a84b5dd0b0f5
https://cdn-avatars.huggingface.co/v1/production/uploads/6434d4989bd5a84b5dd0b0f5/0Elf9qbfG9Hkgypm9pTGm.jpeg
Dayiheng Liu
user
Losin94
651630afbc063171987181d1
Gao Liu
admin_assigned
2023-09-29T11:27:29.483Z
63c5cbe46d132b995ff072b0
/avatars/848180069e75f36bf6d979f2c1aca0ca.svg
Gao LIU
user
etoiles
651630afbc063171987181d2
Chengqiang Lu
claimed_verified
2025-02-21T10:01:34.745Z
61de751fc59d602a3a85b1aa
https://cdn-avatars.huggingface.co/v1/production/uploads/1641968925128-noauth.jpeg
lu
user
cq
651630afbc063171987181d3
Keming Lu
admin_assigned
2023-09-29T11:27:44.635Z
6453fa96ed6d7fede94408e0
/avatars/e8c9025ef24cec958c87a1008bb54fd7.svg
Keming Lu
user
keminglu
651630afbc063171987181d4
Jianxin Ma
651630afbc063171987181d5
Rui Men
claimed_verified
2024-09-23T16:30:31.933Z
6209bb200436d7d6f27cbeea
/avatars/0b8a72a8b66ef7b36780fe2ccc343f78.svg
Iurnem
user
Iurnem
651630afbc063171987181d6
Xingzhang Ren
claimed_verified
2025-01-03T14:07:25.188Z
645c82c4081be4b32049633a
/avatars/e5a08cf0ec5a04bd9d66111382ce0508.svg
xzhren
user
xingzhang
651630afbc063171987181d7
Xuancheng Ren
651630afbc063171987181d8
Chuanqi Tan
651630afbc063171987181d9
Sinan Tan
admin_assigned
2023-09-29T11:28:39.628Z
6337a9bb0267ebcf026ad110
/avatars/12a170b28ade8df979067077828d719c.svg
Sinan Tan
user
tinytangent
651630afbc063171987181da
Jianhong Tu
admin_assigned
2023-09-29T11:28:52.248Z
621a1f739e50c5bea7aa48fb
/avatars/80963b2bf2849d5eac7254541e087663.svg
Tu Jianhong
user
tuhahaha
651630afbc063171987181db
Peng Wang
651630afbc063171987181dc
Shijie Wang
admin_assigned
2023-09-29T11:36:30.321Z
6472321922016353ae3ab2e9
/avatars/93d9e397ae6079ea0672d6b54234f388.svg
Shijie Wang
user
simonJJJ
651630afbc063171987181dd
Wei Wang
651630afbc063171987181de
Shengguang Wu
claimed_verified
2025-02-21T10:01:37.916Z
65222f97ef06bb99753cb829
/avatars/f1a743d74e6d38b916acaec91b4e7e4f.svg
Shengguang Wu
user
danielwusg
651630afbc063171987181df
Benfeng Xu
admin_assigned
2023-09-29T11:37:12.724Z
62d56f063bf5e059f7cac515
/avatars/6bd5cfdc21506ace6176d00a2973d8e5.svg
BenfengXu
user
SpiketheCowboy
651630afbc063171987181e0
Jin Xu
651630afbc063171987181e1
An Yang
claimed_verified
2024-09-23T16:30:30.527Z
62088594a5943c8a8fc94560
https://cdn-avatars.huggingface.co/v1/production/uploads/1644733028938-62088594a5943c8a8fc94560.png
An Yang
user
yangapku
651630afbc063171987181e2
Hao Yang
651630afbc063171987181e3
Jian Yang
claimed_verified
2024-10-14T19:08:22.871Z
66d82581b842183143b87da8
/avatars/8eb678c007879ba1e61272e31086c58b.svg
Jian Yang
user
csjiaya
651630afbc063171987181e4
Shusheng Yang
claimed_verified
2024-12-19T18:06:41.349Z
627ccf058b4e56cfc2716425
https://cdn-avatars.huggingface.co/v1/production/uploads/1652346592327-noauth.jpeg
Shusheng Yang
user
ShushengYang
651630afbc063171987181e5
Yang Yao
651630afbc063171987181e6
Bowen Yu
claimed_verified
2024-06-24T07:36:59.556Z
63d9d68c1cae35c27bf7a6a7
/avatars/b5ad98cf269ae5f1fe90861fb4170fae.svg
Bowen Yu
user
Tigerph
651630afbc063171987181e7
Hongyi Yuan
651630afbc063171987181e8
Zheng Yuan
651630afbc063171987181e9
Jianwei Zhang
651630afbc063171987181ea
Xingxuan Zhang
651630afbc063171987181eb
Yichang Zhang
651630afbc063171987181ec
Zhenru Zhang
admin_assigned
2023-09-29T11:39:00.863Z
64704e973601bb7b06643e98
/avatars/52e51f4d1be6769e4397b8be2799cf32.svg
Zhenru Zhang
user
Zhenru
651630afbc063171987181ed
Chang Zhou
admin_assigned
2023-09-29T11:38:35.560Z
622892774323cef93a956a4a
/avatars/e57ef5c3b0c4289988ccd42f14e54336.svg
chang zhou
user
jiemizc
651630afbc063171987181ee
Jingren Zhou
651630afbc063171987181ef
Xiaohuan Zhou
claimed_verified
2025-03-04T08:54:24.075Z
668f5875b5b3081d776e4094
/avatars/8c763393f25afbe5fb8b132f775e746a.svg
Xiaohuan Zhou
user
XiaohuanZhou
651630afbc063171987181f0
Tianhang Zhu
Qwen Technical Report
Large language models (LLMs) have revolutionized the field of artificial
intelligence, enabling natural language processing tasks that were previously
thought to be exclusive to humans. In this work, we introduce Qwen, the first
installment of our large language model series. Qwen is a comprehensive
language model series that encompasses distinct models with varying parameter
counts. It includes Qwen, the base pretrained language models, and Qwen-Chat,
the chat models finetuned with human alignment techniques. The base language
models consistently demonstrate superior performance across a multitude of
downstream tasks, and the chat models, particularly those trained using
Reinforcement Learning from Human Feedback (RLHF), are highly competitive. The
chat models possess advanced tool-use and planning capabilities for creating
agent applications, showcasing impressive performance even when compared to
bigger models on complex tasks like utilizing a code interpreter. Furthermore,
we have developed coding-specialized models, Code-Qwen and Code-Qwen-Chat, as
well as mathematics-focused models, Math-Qwen-Chat, which are built upon base
language models. These models demonstrate significantly improved performance in
comparison with open-source models, and slightly fall behind the proprietary
models.
Qwen, a series of large language models, including chat and specialized coding and mathematics variants, exhibit superior performance across various tasks and outperform open-source models.
LLMs large language models pretrained language models Reinforcement Learning from Human Feedback RLHF chat models tool-use planning capabilities agent applications coding-specialized models mathematics-focused models