title: CogView3: Finer and Faster Text-to-Image Generation via Relay Diffusion
summary: Recent advancements in text-to-image generative systems have been largely
  driven by diffusion models. However, single-stage text-to-image diffusion
  models still face challenges, in terms of computational efficiency and the
  refinement of image details. To tackle the issue, we propose CogView3, an
  innovative cascaded framework that enhances the performance of text-to-image
  diffusion. CogView3 is the first model implementing relay diffusion in the
  realm of text-to-image generation, executing the task by first creating
  low-resolution images and subsequently applying relay-based super-resolution.
  This methodology not only results in competitive text-to-image outputs but also
  greatly reduces both training and inference costs. Our experimental results
  demonstrate that CogView3 outperforms SDXL, the current state-of-the-art
  open-source text-to-image diffusion model, by 77.0\% in human evaluations, all
  while requiring only about 1/2 of the inference time. The distilled variant of
  CogView3 achieves comparable performance while only utilizing 1/10 of the
  inference time by SDXL.
paper_authors._id: 65ee76bee28439e21ba81866
paper_authors.name: Wendi Zheng
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-11T09:09:59.364Z
paper_authors._id: 650aaaf1634e02df56dfd231
paper_authors.avatarUrl: /avatars/4643ab23721d4ed6aeb1ebbc717adc43.svg
paper_authors.fullname: Wendi Zheng
paper_authors.type: user
paper_authors.user: zwd125
paper_authors._id: 65ee76bee28439e21ba81867
paper_authors.name: Jiayan Teng
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-11T09:10:12.419Z
paper_authors._id: 65228733377bffdc59a10117
paper_authors.avatarUrl: /avatars/6eec07553658ab22f8058caa0bfbed49.svg
paper_authors.fullname: tengjiayan
paper_authors.type: user
paper_authors.user: tengjiayan
paper_authors._id: 65ee76bee28439e21ba81868
paper_authors.name: Zhuoyi Yang
paper_authors._id: 65ee76bee28439e21ba81869
paper_authors.name: Weihan Wang
paper_authors._id: 65ee76bee28439e21ba8186a
paper_authors.name: Jidong Chen
paper_authors._id: 65ee76bee28439e21ba8186b
paper_authors.name: Xiaotao Gu
paper_authors._id: 65ee76bee28439e21ba8186c
paper_authors.name: Yuxiao Dong
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-11T09:11:17.887Z
paper_authors._id: 640e73bdfdeaae1390857b62
paper_authors.avatarUrl: /avatars/cd6779e30f716002a7838ed93d5c0754.svg
paper_authors.fullname: Yuxiao Dong
paper_authors.type: user
paper_authors.user: yuxiaod
paper_authors._id: 65ee76bee28439e21ba8186d
paper_authors.name: Ming Ding
paper_authors._id: 65ee76bee28439e21ba8186e
paper_authors.name: Jie Tang
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-11T09:11:52.276Z
paper_authors._id: 640dff05474aa6f89556677e
paper_authors.avatarUrl: /avatars/1b4591c7322d649c797b3125148f1915.svg
paper_authors.fullname: Jie Tang
paper_authors.type: user
paper_authors.user: jerytang
paper_title: CogView3: Finer and Faster Text-to-Image Generation via Relay Diffusion
paper_summary: Recent advancements in text-to-image generative systems have been largely
  driven by diffusion models. However, single-stage text-to-image diffusion
  models still face challenges, in terms of computational efficiency and the
  refinement of image details. To tackle the issue, we propose CogView3, an
  innovative cascaded framework that enhances the performance of text-to-image
  diffusion. CogView3 is the first model implementing relay diffusion in the
  realm of text-to-image generation, executing the task by first creating
  low-resolution images and subsequently applying relay-based super-resolution.
  This methodology not only results in competitive text-to-image outputs but also
  greatly reduces both training and inference costs. Our experimental results
  demonstrate that CogView3 outperforms SDXL, the current state-of-the-art
  open-source text-to-image diffusion model, by 77.0\% in human evaluations, all
  while requiring only about 1/2 of the inference time. The distilled variant of
  CogView3 achieves comparable performance while only utilizing 1/10 of the
  inference time by SDXL.
paper_ai_keywords: diffusion models text-to-image diffusion cascaded framework relay diffusion low-resolution images relay-based super-resolution training costs inference costs human evaluations