title: Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with
    Fine-Grained Chinese Understanding
summary: We present Hunyuan-DiT, a text-to-image diffusion transformer with
  fine-grained understanding of both English and Chinese. To construct
  Hunyuan-DiT, we carefully design the transformer structure, text encoder, and
  positional encoding. We also build from scratch a whole data pipeline to update
  and evaluate data for iterative model optimization. For fine-grained language
  understanding, we train a Multimodal Large Language Model to refine the
  captions of the images. Finally, Hunyuan-DiT can perform multi-turn multimodal
  dialogue with users, generating and refining images according to the context.
  Through our holistic human evaluation protocol with more than 50 professional
  human evaluators, Hunyuan-DiT sets a new state-of-the-art in Chinese-to-image
  generation compared with other open-source models. Code and pretrained models
  are publicly available at github.com/Tencent/HunyuanDiT
paper_authors._id: 6644709bbc86c9465b8ec37f
paper_authors.name: Zhimin Li
paper_authors._id: 6644709bbc86c9465b8ec380
paper_authors.name: Jianwei Zhang
paper_authors._id: 6644709bbc86c9465b8ec381
paper_authors.name: Qin Lin
paper_authors._id: 6644709bbc86c9465b8ec382
paper_authors.name: Jiangfeng Xiong
paper_authors._id: 6644709bbc86c9465b8ec383
paper_authors.name: Yanxin Long
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-05-17T07:15:43.339Z
paper_authors._id: 64dd8a1e22f93c32882eb2fe
paper_authors.avatarUrl: /avatars/a5e84a5c5a14058d91c342f8c89a36a2.svg
paper_authors.fullname: yanxin long
paper_authors.type: user
paper_authors.user: yestinl
paper_authors._id: 6644709bbc86c9465b8ec384
paper_authors.name: Xinchi Deng
paper_authors._id: 6644709bbc86c9465b8ec385
paper_authors.name: Yingfang Zhang
paper_authors._id: 6644709bbc86c9465b8ec386
paper_authors.name: Xingchao Liu
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-05-15T19:44:07.916Z
paper_authors._id: 646b0bbdec9a61e871799339
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/646b0bbdec9a61e871799339/Xippv-ajkHkrGGAA7caLn.jpeg
paper_authors.fullname: Xingchao Liu
paper_authors.type: user
paper_authors.user: XCLiu
paper_authors._id: 6644709bbc86c9465b8ec387
paper_authors.name: Minbin Huang
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-05-15T19:44:17.994Z
paper_authors._id: 6507f434dacc94cd6c2a8700
paper_authors.avatarUrl: /avatars/71bf2dff7119f9fd2c01ddf925229239.svg
paper_authors.fullname: Minbin Huang
paper_authors.type: user
paper_authors.user: centaurus-alpha
paper_authors._id: 6644709bbc86c9465b8ec388
paper_authors.name: Zedong Xiao
paper_authors._id: 6644709bbc86c9465b8ec389
paper_authors.name: Dayou Chen
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-05-15T19:44:36.061Z
paper_authors._id: 6420ff4369a2c293388241ec
paper_authors.avatarUrl: /avatars/20f50f10902496df2cfbadbfafba9cf7.svg
paper_authors.fullname: Dayou Chen
paper_authors.type: user
paper_authors.user: dayoucdy
paper_authors._id: 6644709bbc86c9465b8ec38a
paper_authors.name: Jiajun He
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-05-15T19:44:44.346Z
paper_authors._id: 63ecb9bb54bba678151727b2
paper_authors.avatarUrl: /avatars/3712d765452b3ea7234a3211cafc7008.svg
paper_authors.fullname: Jiajun He
paper_authors.type: user
paper_authors.user: JJHE
paper_authors._id: 6644709bbc86c9465b8ec38b
paper_authors.name: Jiahao Li
paper_authors._id: 6644709bbc86c9465b8ec38c
paper_authors.name: Wenyue Li
paper_authors._id: 6644709bbc86c9465b8ec38d
paper_authors.name: Chen Zhang
paper_authors._id: 6644709bbc86c9465b8ec38e
paper_authors.name: Rongwei Quan
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-05-15T19:45:28.686Z
paper_authors._id: 630848b76bf7bb2fee642d6b
paper_authors.avatarUrl: /avatars/5c1c3c9ade13e748fb37e687d92e0c3c.svg
paper_authors.fullname: Rongwei Quan
paper_authors.type: user
paper_authors.user: Authority
paper_authors._id: 6644709bbc86c9465b8ec38f
paper_authors.name: Jianxiang Lu
paper_authors._id: 6644709bbc86c9465b8ec390
paper_authors.name: Jiabin Huang
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-05-15T19:45:44.632Z
paper_authors._id: 641c139b73296f7ee256970c
paper_authors.avatarUrl: /avatars/5a2550d95e686640242840ad3bd0e680.svg
paper_authors.fullname: Jiabin Huang
paper_authors.type: user
paper_authors.user: YellowAddice
paper_authors._id: 6644709bbc86c9465b8ec391
paper_authors.name: Xiaoyan Yuan
paper_authors._id: 6644709bbc86c9465b8ec392
paper_authors.name: Xiaoxiao Zheng
paper_authors._id: 6644709bbc86c9465b8ec393
paper_authors.name: Yixuan Li
paper_authors._id: 6644709bbc86c9465b8ec394
paper_authors.name: Jihong Zhang
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-05-15T19:46:34.429Z
paper_authors._id: 6467254376bb704aa13fb86f
paper_authors.avatarUrl: /avatars/2c13f9184e782de7d9513171584935df.svg
paper_authors.fullname: zhangjihong
paper_authors.type: user
paper_authors.user: zhangjh666
paper_authors._id: 6644709bbc86c9465b8ec395
paper_authors.name: Chao Zhang
paper_authors._id: 6644709bbc86c9465b8ec396
paper_authors.name: Meng Chen
paper_authors._id: 6644709bbc86c9465b8ec397
paper_authors.name: Jie Liu
paper_authors._id: 6644709bbc86c9465b8ec398
paper_authors.name: Zheng Fang
paper_authors._id: 6644709bbc86c9465b8ec399
paper_authors.name: Weiyan Wang
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-05-15T19:51:19.270Z
paper_authors._id: 65796876d54197901f9003ce
paper_authors.avatarUrl: /avatars/ed06d346beca637a24bf4d51ac2ad56b.svg
paper_authors.fullname: Weiyan Wang
paper_authors.type: user
paper_authors.user: outstander
paper_authors._id: 6644709bbc86c9465b8ec39a
paper_authors.name: Jinbao Xue
paper_authors._id: 6644709bbc86c9465b8ec39b
paper_authors.name: Yangyu Tao
paper_authors._id: 6644709bbc86c9465b8ec39c
paper_authors.name: Jianchen Zhu
paper_authors._id: 6644709bbc86c9465b8ec39d
paper_authors.name: Kai Liu
paper_authors._id: 6644709bbc86c9465b8ec39e
paper_authors.name: Sihuan Lin
paper_authors._id: 6644709bbc86c9465b8ec39f
paper_authors.name: Yifu Sun
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-05-15T19:52:33.954Z
paper_authors._id: 650278893c7d1b2e5bb059b4
paper_authors.avatarUrl: /avatars/b0ac7213b4610a01dfef4cbfedd29740.svg
paper_authors.fullname: Yifu Sun
paper_authors.type: user
paper_authors.user: tomsunyifu
paper_authors._id: 6644709bbc86c9465b8ec3a0
paper_authors.name: Yun Li
paper_authors._id: 6644709bbc86c9465b8ec3a1
paper_authors.name: Dongdong Wang
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-05-15T19:52:43.962Z
paper_authors._id: 65f7f7dbd348df41c96af9bd
paper_authors.avatarUrl: /avatars/1077ec83ac0b0335939166f635c5d9b9.svg
paper_authors.fullname: Dongdong Wang
paper_authors.type: user
paper_authors.user: Dongdawn1120
paper_authors._id: 6644709bbc86c9465b8ec3a2
paper_authors.name: Mingtao Chen
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-05-15T19:52:54.069Z
paper_authors._id: 6448e0ebe87a77e872e4b852
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/6448e0ebe87a77e872e4b852/yJ65YXdnfJSZx16PZxhJA.png
paper_authors.fullname: Mingtao Chen
paper_authors.type: user
paper_authors.user: meton
paper_authors._id: 6644709bbc86c9465b8ec3a3
paper_authors.name: Zhichao Hu
paper_authors._id: 6644709bbc86c9465b8ec3a4
paper_authors.name: Xiao Xiao
paper_authors._id: 6644709bbc86c9465b8ec3a5
paper_authors.name: Yan Chen
paper_authors._id: 6644709bbc86c9465b8ec3a6
paper_authors.name: Yuhong Liu
paper_authors._id: 6644709bbc86c9465b8ec3a7
paper_authors.name: Wei Liu
paper_authors._id: 6644709bbc86c9465b8ec3a8
paper_authors.name: Di Wang
paper_authors._id: 6644709bbc86c9465b8ec3a9
paper_authors.name: Yong Yang
paper_authors._id: 6644709bbc86c9465b8ec3aa
paper_authors.name: Jie Jiang
paper_authors._id: 6644709bbc86c9465b8ec3ab
paper_authors.name: Qinglin Lu
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-05-15T19:53:18.379Z
paper_authors._id: 64c13276b4fd9b97756b1783
paper_authors.avatarUrl: /avatars/a1d0480fa94f59ed5db3a1bba09bd660.svg
paper_authors.fullname: lu
paper_authors.type: user
paper_authors.user: qinglin3
paper_title: Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with
    Fine-Grained Chinese Understanding
paper_summary: We present Hunyuan-DiT, a text-to-image diffusion transformer with
  fine-grained understanding of both English and Chinese. To construct
  Hunyuan-DiT, we carefully design the transformer structure, text encoder, and
  positional encoding. We also build from scratch a whole data pipeline to update
  and evaluate data for iterative model optimization. For fine-grained language
  understanding, we train a Multimodal Large Language Model to refine the
  captions of the images. Finally, Hunyuan-DiT can perform multi-turn multimodal
  dialogue with users, generating and refining images according to the context.
  Through our holistic human evaluation protocol with more than 50 professional
  human evaluators, Hunyuan-DiT sets a new state-of-the-art in Chinese-to-image
  generation compared with other open-source models. Code and pretrained models
  are publicly available at github.com/Tencent/HunyuanDiT
paper_ai_keywords: diffusion transformer text encoder positional encoding multimodal large language model multilingual understanding multimodal dialogue human evaluation protocol Chinese-to-image generation