ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All
  Tools
We introduce ChatGLM, an evolving family of large language models that we
have been developing over time. This report primarily focuses on the GLM-4
language series, which includes GLM-4, GLM-4-Air, and GLM-4-9B. They represent
our most capable models that are trained with all the insights and lessons
gained from the preceding three generations of ChatGLM. To date, the GLM-4
models are pre-trained on ten trillions of tokens mostly in Chinese and
English, along with a small set of corpus from 24 languages, and aligned
primarily for Chinese and English usage. The high-quality alignment is achieved
via a multi-stage post-training process, which involves supervised fine-tuning
and learning from human feedback. Evaluations show that GLM-4 1) closely rivals
or outperforms GPT-4 in terms of general metrics such as MMLU, GSM8K, MATH,
BBH, GPQA, and HumanEval, 2) gets close to GPT-4-Turbo in instruction following
as measured by IFEval, 3) matches GPT-4 Turbo (128K) and Claude 3 for long
context tasks, and 4) outperforms GPT-4 in Chinese alignments as measured by
AlignBench. The GLM-4 All Tools model is further aligned to understand user
intent and autonomously decide when and which tool(s) touse -- including web
browser, Python interpreter, text-to-image model, and user-defined functions --
to effectively complete complex tasks. In practical applications, it matches
and even surpasses GPT-4 All Tools in tasks like accessing online information
via web browsing and solving math problems using Python interpreter. Over the
course, we have open-sourced a series of models, including ChatGLM-6B (three
generations), GLM-4-9B (128K, 1M), GLM-4V-9B, WebGLM, and CodeGeeX, attracting
over 10 million downloads on Hugging face in the year 2023 alone. The open
models can be accessed through https://github.com/THUDM and
https://huggingface.co/THUDM.
66724df48171db46e7e4ab53
Team GLM
66724df48171db46e7e4ab55
Aohan Zeng
admin_assigned
2024-06-19T08:41:44.879Z
62dc173789b4cf157d36ebee
https://cdn-avatars.huggingface.co/v1/production/uploads/1659772051636-62dc173789b4cf157d36ebee.jpeg
Zeng Aohan
user
Sengxian
66724df48171db46e7e4ab56
Bin Xu
66724df48171db46e7e4ab57
Bowen Wang
66724df48171db46e7e4ab58
Chenhui Zhang
admin_assigned
2024-06-19T08:42:10.316Z
64522233ea94bf023430dd95
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/CVDqDeJ_fLTULhCTTSogb.png
Chenhui Zhang
user
danielz01
66724df48171db46e7e4ab59
Da Yin
admin_assigned
2024-06-19T08:42:24.927Z
634e4670a51d5df8c2d92fce
/avatars/c52d7150b4de6a2eb2d83b345d35cbc2.svg
Da Yin
user
DaYin
66724df48171db46e7e4ab5a
Diego Rojas
admin_assigned
2024-06-19T08:42:31.177Z
65fbb0e5fb66882aba301a23
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/4TBIdLkQTO05YqOYqvi_L.jpeg
Diego Rojas
user
d4ndres
66724df48171db46e7e4ab5b
Guanyu Feng
admin_assigned
2024-06-19T08:42:37.172Z
64d996d6bcab729cb400cb70
/avatars/3db57c8b643fba8302ed39d8cf0f4ddb.svg
Guanyu Feng
user
jiguanglizipao
66724df48171db46e7e4ab5c
Hanlin Zhao
admin_assigned
2024-06-19T08:42:49.585Z
647aa6121eff17116fa61213
/avatars/0735b857db37e59018fb5aa1dd231000.svg
zhaohanlin
user
ultrazhl
66724df48171db46e7e4ab5d
Hanyu Lai
admin_assigned
2024-06-19T08:43:16.931Z
62ea2d48b493272c269e8f34
/avatars/89b215dafa503b51ab212a9b63c82aca.svg
Hanyu Lai
user
hanyullai
66724df48171db46e7e4ab5e
Hao Yu
66724df48171db46e7e4ab5f
Hongning Wang
66724df48171db46e7e4ab60
Jiadai Sun
admin_assigned
2024-06-19T08:43:35.519Z
64e82f2c9a3cd93b370e9936
/avatars/942e6008e8e78583c2750d678fcaadb1.svg
jiadaisun
user
jiadaisun
66724df48171db46e7e4ab61
Jiajie Zhang
claimed_verified
2024-09-04T07:25:42.974Z
66cdd285c51a915bd5f2d017
/avatars/14e5794307e4672b1b51d26b31227e0f.svg
Jiajie Zhang
user
NeoZ123
66724df48171db46e7e4ab62
Jiale Cheng
admin_assigned
2024-06-19T08:43:42.588Z
661315151810ef13df2f7ae3
/avatars/c41ae68b406e90fc66c879c1bb50c11d.svg
Jiale Cheng
user
Jialejl
66724df48171db46e7e4ab63
Jiayi Gui
admin_assigned
2024-06-19T08:43:48.199Z
62cc0ba648c278718d078c4c
/avatars/bfd87287536ef53ec555c0cc7a25ac72.svg
Jiayi Gui
user
Hypatia
66724df48171db46e7e4ab64
Jie Tang
admin_assigned
2024-06-19T08:44:21.395Z
640dff05474aa6f89556677e
/avatars/1b4591c7322d649c797b3125148f1915.svg
Jie Tang
user
jerytang
66724df48171db46e7e4ab65
Jing Zhang
66724df48171db46e7e4ab66
Juanzi Li
admin_assigned
2024-06-19T08:45:16.849Z
65df8cbc2705d9672f55d1aa
/avatars/63e46f15bb76bd9d4508fd0f54f39829.svg
Juanzi Li
user
juanli
66724df48171db46e7e4ab67
Lei Zhao
66724df48171db46e7e4ab68
Lindong Wu
66724df48171db46e7e4ab69
Lucen Zhong
admin_assigned
2024-06-19T08:45:05.276Z
60eff04e22ab0ac83b0fc9d8
https://cdn-avatars.huggingface.co/v1/production/uploads/60eff04e22ab0ac83b0fc9d8/pBjftNyFN1qB8Br3FZQmD.jpeg
lucen zhong
user
anchorzhong
66724df48171db46e7e4ab6a
Mingdao Liu
66724df48171db46e7e4ab6b
Minlie Huang
66724df48171db46e7e4ab6c
Peng Zhang
66724df48171db46e7e4ab6d
Qinkai Zheng
claimed_verified
2025-07-04T07:52:27.123Z
6231576e92e83fd1179ac3f0
https://cdn-avatars.huggingface.co/v1/production/uploads/1664543160657-6231576e92e83fd1179ac3f0.jpeg
Qinkai Zheng
user
Stanislas
66724df48171db46e7e4ab6e
Rui Lu
claimed_verified
2024-06-20T07:34:29.621Z
63ca0433b047b9b12a1fcd9c
/avatars/435507115bfc502c494989677cfca5fb.svg
Rui Lu
user
learning-rate
66724df48171db46e7e4ab6f
Shuaiqi Duan
claimed_verified
2025-07-02T08:32:54.583Z
64004a2d261cfa61f39ab8a0
https://cdn-avatars.huggingface.co/v1/production/uploads/64004a2d261cfa61f39ab8a0/7NnGXeuORNVZOZLA1EYFx.jpeg
ShuaiqiDuan
user
ShayDuane
66724df48171db46e7e4ab70
Shudan Zhang
66724df48171db46e7e4ab71
Shulin Cao
66724df48171db46e7e4ab72
Shuxun Yang
66724df48171db46e7e4ab73
Weng Lam Tam
66724df48171db46e7e4ab74
Wenyi Zhao
66724df48171db46e7e4ab75
Xiao Liu
claimed_verified
2024-11-05T16:09:41.252Z
62f098602ca4d32a7cd87aba
https://cdn-avatars.huggingface.co/v1/production/uploads/1659934844914-62f098602ca4d32a7cd87aba.jpeg
Xiao Liu
user
ShawLiu
66724df48171db46e7e4ab76
Xiao Xia
66724df48171db46e7e4ab77
Xiaohan Zhang
66724df48171db46e7e4ab78
Xiaotao Gu
claimed_verified
2025-07-02T09:25:14.974Z
6438bca4a5e10f6d58694b47
/avatars/3aeb25fbc73c5cab1265e13d11adfb76.svg
Xiaotao Gu
user
xgeric
66724df48171db46e7e4ab79
Xin Lv
claimed_verified
2024-06-20T07:34:31.505Z
648c64829c935db2b527a764
https://cdn-avatars.huggingface.co/v1/production/uploads/648c64829c935db2b527a764/AnTu1dvpac3hUxLQo8A8K.jpeg
Xin Lv
user
davidlvxin
66724df48171db46e7e4ab7a
Xinghan Liu
66724df48171db46e7e4ab7b
Xinyi Liu
66724df48171db46e7e4ab7c
Xinyue Yang
66724df48171db46e7e4ab7d
Xixuan Song
66724df48171db46e7e4ab7e
Xunkai Zhang
66724df48171db46e7e4ab7f
Yifan An
66724df48171db46e7e4ab80
Yifan Xu
66724df48171db46e7e4ab81
Yilin Niu
66724df48171db46e7e4ab82
Yuantao Yang
66724df48171db46e7e4ab83
Yueyan Li
66724df48171db46e7e4ab84
Yushi Bai
claimed_verified
2024-06-19T20:20:47.507Z
64ed568ccf6118a9379a61b8
/avatars/6d040cbcb4a9b624cbe64c9d01cd5c88.svg
Yushi Bai
user
bys0318
66724df48171db46e7e4ab85
Yuxiao Dong
66724df48171db46e7e4ab86
Zehan Qi
66724df48171db46e7e4ab87
Zhaoyu Wang
66724df48171db46e7e4ab88
Zhen Yang
claimed_verified
2025-07-02T08:55:40.130Z
650c0f7fdab7deefd4631109
/avatars/3d0683d1113c3bd530b5e8b1499b17f6.svg
ZhenYang21
user
ZhenYang21
66724df48171db46e7e4ab89
Zhengxiao Du
66724df48171db46e7e4ab8a
Zhenyu Hou
claimed_verified
2025-01-23T09:22:13.785Z
62b196646d3d059f40c3df19
/avatars/dbddf54ae949437223f3a438d30ef653.svg
Zhenyu Hou
user
think2try
66724df48171db46e7e4ab8b
Zihan Wang
ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All
  Tools
We introduce ChatGLM, an evolving family of large language models that we
have been developing over time. This report primarily focuses on the GLM-4
language series, which includes GLM-4, GLM-4-Air, and GLM-4-9B. They represent
our most capable models that are trained with all the insights and lessons
gained from the preceding three generations of ChatGLM. To date, the GLM-4
models are pre-trained on ten trillions of tokens mostly in Chinese and
English, along with a small set of corpus from 24 languages, and aligned
primarily for Chinese and English usage. The high-quality alignment is achieved
via a multi-stage post-training process, which involves supervised fine-tuning
and learning from human feedback. Evaluations show that GLM-4 1) closely rivals
or outperforms GPT-4 in terms of general metrics such as MMLU, GSM8K, MATH,
BBH, GPQA, and HumanEval, 2) gets close to GPT-4-Turbo in instruction following
as measured by IFEval, 3) matches GPT-4 Turbo (128K) and Claude 3 for long
context tasks, and 4) outperforms GPT-4 in Chinese alignments as measured by
AlignBench. The GLM-4 All Tools model is further aligned to understand user
intent and autonomously decide when and which tool(s) touse -- including web
browser, Python interpreter, text-to-image model, and user-defined functions --
to effectively complete complex tasks. In practical applications, it matches
and even surpasses GPT-4 All Tools in tasks like accessing online information
via web browsing and solving math problems using Python interpreter. Over the
course, we have open-sourced a series of models, including ChatGLM-6B (three
generations), GLM-4-9B (128K, 1M), GLM-4V-9B, WebGLM, and CodeGeeX, attracting
over 10 million downloads on Hugging face in the year 2023 alone. The open
models can be accessed through https://github.com/THUDM and
https://huggingface.co/THUDM.
GLM-4 language models, trained on diverse datasets, outperform GPT-4 in various tasks and feature tool integration capabilities that match or surpass those of GPT-4 All Tools.
ChatGLM (GLM-4 GLM-4-Air GLM-4-9B LLM pre-training multi-stage post-training supervised fine-tuning learning from human feedback MMLU GSM8K MATH BBH GPQA HumanEval IFEval long context tasks AlignBench GLM-4 All Tools web browser Python interpreter text-to-image model user-defined functions tool alignment complex tasks Hugging Face THUDM open-source models