Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with
  Fine-Grained Chinese Understanding
We present Hunyuan-DiT, a text-to-image diffusion transformer with
fine-grained understanding of both English and Chinese. To construct
Hunyuan-DiT, we carefully design the transformer structure, text encoder, and
positional encoding. We also build from scratch a whole data pipeline to update
and evaluate data for iterative model optimization. For fine-grained language
understanding, we train a Multimodal Large Language Model to refine the
captions of the images. Finally, Hunyuan-DiT can perform multi-turn multimodal
dialogue with users, generating and refining images according to the context.
Through our holistic human evaluation protocol with more than 50 professional
human evaluators, Hunyuan-DiT sets a new state-of-the-art in Chinese-to-image
generation compared with other open-source models. Code and pretrained models
are publicly available at github.com/Tencent/HunyuanDiT
6644709bbc86c9465b8ec37f
Zhimin Li
6644709bbc86c9465b8ec380
Jianwei Zhang
6644709bbc86c9465b8ec381
Qin Lin
6644709bbc86c9465b8ec382
Jiangfeng Xiong
6644709bbc86c9465b8ec383
Yanxin Long
claimed_verified
2024-05-17T07:15:43.339Z
64dd8a1e22f93c32882eb2fe
/avatars/a5e84a5c5a14058d91c342f8c89a36a2.svg
yanxin long
user
yestinl
6644709bbc86c9465b8ec384
Xinchi Deng
6644709bbc86c9465b8ec385
Yingfang Zhang
6644709bbc86c9465b8ec386
Xingchao Liu
admin_assigned
2024-05-15T19:44:07.916Z
646b0bbdec9a61e871799339
https://cdn-avatars.huggingface.co/v1/production/uploads/646b0bbdec9a61e871799339/Xippv-ajkHkrGGAA7caLn.jpeg
Xingchao Liu
user
XCLiu
6644709bbc86c9465b8ec387
Minbin Huang
admin_assigned
2024-05-15T19:44:17.994Z
6507f434dacc94cd6c2a8700
/avatars/71bf2dff7119f9fd2c01ddf925229239.svg
Minbin Huang
user
centaurus-alpha
6644709bbc86c9465b8ec388
Zedong Xiao
6644709bbc86c9465b8ec389
Dayou Chen
admin_assigned
2024-05-15T19:44:36.061Z
6420ff4369a2c293388241ec
/avatars/20f50f10902496df2cfbadbfafba9cf7.svg
Dayou Chen
user
dayoucdy
6644709bbc86c9465b8ec38a
Jiajun He
admin_assigned
2024-05-15T19:44:44.346Z
63ecb9bb54bba678151727b2
/avatars/3712d765452b3ea7234a3211cafc7008.svg
Jiajun He
user
JJHE
6644709bbc86c9465b8ec38b
Jiahao Li
6644709bbc86c9465b8ec38c
Wenyue Li
6644709bbc86c9465b8ec38d
Chen Zhang
6644709bbc86c9465b8ec38e
Rongwei Quan
admin_assigned
2024-05-15T19:45:28.686Z
630848b76bf7bb2fee642d6b
/avatars/5c1c3c9ade13e748fb37e687d92e0c3c.svg
Rongwei Quan
user
Authority
6644709bbc86c9465b8ec38f
Jianxiang Lu
6644709bbc86c9465b8ec390
Jiabin Huang
admin_assigned
2024-05-15T19:45:44.632Z
641c139b73296f7ee256970c
/avatars/5a2550d95e686640242840ad3bd0e680.svg
Jiabin Huang
user
YellowAddice
6644709bbc86c9465b8ec391
Xiaoyan Yuan
6644709bbc86c9465b8ec392
Xiaoxiao Zheng
6644709bbc86c9465b8ec393
Yixuan Li
6644709bbc86c9465b8ec394
Jihong Zhang
admin_assigned
2024-05-15T19:46:34.429Z
6467254376bb704aa13fb86f
/avatars/2c13f9184e782de7d9513171584935df.svg
zhangjihong
user
zhangjh666
6644709bbc86c9465b8ec395
Chao Zhang
6644709bbc86c9465b8ec396
Meng Chen
6644709bbc86c9465b8ec397
Jie Liu
6644709bbc86c9465b8ec398
Zheng Fang
6644709bbc86c9465b8ec399
Weiyan Wang
admin_assigned
2024-05-15T19:51:19.270Z
65796876d54197901f9003ce
/avatars/ed06d346beca637a24bf4d51ac2ad56b.svg
Weiyan Wang
user
outstander
6644709bbc86c9465b8ec39a
Jinbao Xue
6644709bbc86c9465b8ec39b
Yangyu Tao
6644709bbc86c9465b8ec39c
Jianchen Zhu
6644709bbc86c9465b8ec39d
Kai Liu
6644709bbc86c9465b8ec39e
Sihuan Lin
6644709bbc86c9465b8ec39f
Yifu Sun
admin_assigned
2024-05-15T19:52:33.954Z
650278893c7d1b2e5bb059b4
/avatars/b0ac7213b4610a01dfef4cbfedd29740.svg
Yifu Sun
user
tomsunyifu
6644709bbc86c9465b8ec3a0
Yun Li
6644709bbc86c9465b8ec3a1
Dongdong Wang
admin_assigned
2024-05-15T19:52:43.962Z
65f7f7dbd348df41c96af9bd
/avatars/1077ec83ac0b0335939166f635c5d9b9.svg
Dongdong Wang
user
Dongdawn1120
6644709bbc86c9465b8ec3a2
Mingtao Chen
admin_assigned
2024-05-15T19:52:54.069Z
6448e0ebe87a77e872e4b852
https://cdn-avatars.huggingface.co/v1/production/uploads/6448e0ebe87a77e872e4b852/yJ65YXdnfJSZx16PZxhJA.png
Mingtao Chen
user
meton
6644709bbc86c9465b8ec3a3
Zhichao Hu
6644709bbc86c9465b8ec3a4
Xiao Xiao
6644709bbc86c9465b8ec3a5
Yan Chen
6644709bbc86c9465b8ec3a6
Yuhong Liu
6644709bbc86c9465b8ec3a7
Wei Liu
6644709bbc86c9465b8ec3a8
Di Wang
6644709bbc86c9465b8ec3a9
Yong Yang
6644709bbc86c9465b8ec3aa
Jie Jiang
6644709bbc86c9465b8ec3ab
Qinglin Lu
admin_assigned
2024-05-15T19:53:18.379Z
64c13276b4fd9b97756b1783
/avatars/a1d0480fa94f59ed5db3a1bba09bd660.svg
lu
user
qinglin3
Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with
  Fine-Grained Chinese Understanding
We present Hunyuan-DiT, a text-to-image diffusion transformer with
fine-grained understanding of both English and Chinese. To construct
Hunyuan-DiT, we carefully design the transformer structure, text encoder, and
positional encoding. We also build from scratch a whole data pipeline to update
and evaluate data for iterative model optimization. For fine-grained language
understanding, we train a Multimodal Large Language Model to refine the
captions of the images. Finally, Hunyuan-DiT can perform multi-turn multimodal
dialogue with users, generating and refining images according to the context.
Through our holistic human evaluation protocol with more than 50 professional
human evaluators, Hunyuan-DiT sets a new state-of-the-art in Chinese-to-image
generation compared with other open-source models. Code and pretrained models
are publicly available at github.com/Tencent/HunyuanDiT
Hunyuan-DiT, a text-to-image diffusion transformer, achieves state-of-the-art in Chinese-to-image generation by incorporating fine-grained language understanding and multi-turn dialogue capabilities.
text-to-image diffusion transformer multimodal large language model transformer structure text encoder positional encoding multi-turn multimodal dialogue