Meissonic: Revitalizing Masked Generative Transformers for Efficient
  High-Resolution Text-to-Image Synthesis
Diffusion models, such as Stable Diffusion, have made significant strides in
visual generation, yet their paradigm remains fundamentally different from
autoregressive language models, complicating the development of unified
language-vision models. Recent efforts like LlamaGen have attempted
autoregressive image generation using discrete VQVAE tokens, but the large
number of tokens involved renders this approach inefficient and slow. In this
work, we present Meissonic, which elevates non-autoregressive masked image
modeling (MIM) text-to-image to a level comparable with state-of-the-art
diffusion models like SDXL. By incorporating a comprehensive suite of
architectural innovations, advanced positional encoding strategies, and
optimized sampling conditions, Meissonic substantially improves MIM's
performance and efficiency. Additionally, we leverage high-quality training
data, integrate micro-conditions informed by human preference scores, and
employ feature compression layers to further enhance image fidelity and
resolution. Our model not only matches but often exceeds the performance of
existing models like SDXL in generating high-quality, high-resolution images.
Extensive experiments validate Meissonic's capabilities, demonstrating its
potential as a new standard in text-to-image synthesis. We release a model
checkpoint capable of producing 1024 times 1024 resolution images.
670c859d0b54b420bb46330e
Jinbin Bai
claimed_verified
2024-10-14T07:48:20.758Z
63fccdac93b993a4ebd7789a
https://cdn-avatars.huggingface.co/v1/production/uploads/63fccdac93b993a4ebd7789a/KRx8vpdoDjsZBRw0j8Vg8.jpeg
Jinbin Bai
user
BryanW
670c859d0b54b420bb46330f
Tian Ye
claimed_verified
2024-10-14T07:48:17.347Z
66015e8aa4d296af07de538e
/avatars/a1295c631cc2646282c545859975ce4c.svg
Owen
user
Owen777
670c859d0b54b420bb463310
Wei Chow
admin_assigned
2024-10-14T08:12:54.075Z
644b71ddb2e7823a76abcf91
https://cdn-avatars.huggingface.co/v1/production/uploads/644b71ddb2e7823a76abcf91/JPF7Eqeq2jx8i79nQ962K.jpeg
zhou wei
user
WeiChow
670c859d0b54b420bb463311
Enxin Song
admin_assigned
2024-10-14T08:13:06.950Z
63a7b196e27a6dbd4861e275
https://cdn-avatars.huggingface.co/v1/production/uploads/63a7b196e27a6dbd4861e275/QGn4hdDPNuSRgZVKxzDpq.jpeg
EnxinSong
user
Enxin
670c859d0b54b420bb463312
Qing-Guo Chen
670c859d0b54b420bb463313
Xiangtai Li
claimed_verified
2024-10-14T07:48:15.462Z
63958b4414513eaf9029ebf1
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/U1g5H071pWRswGAG9UTpo.png
Xiangtai Li
user
LXT
670c859d0b54b420bb463314
Zhen Dong
claimed_verified
2024-10-14T07:48:19.035Z
643ba2f725681c3afaa8f05e
https://cdn-avatars.huggingface.co/v1/production/uploads/643ba2f725681c3afaa8f05e/2RnOdmbBM8WHYhiTGG-Cd.jpeg
Zhen Dong
user
zhendongucb
670c859d0b54b420bb463315
Lei Zhu
670c859d0b54b420bb463316
Shuicheng Yan
Meissonic: Revitalizing Masked Generative Transformers for Efficient
  High-Resolution Text-to-Image Synthesis
Diffusion models, such as Stable Diffusion, have made significant strides in
visual generation, yet their paradigm remains fundamentally different from
autoregressive language models, complicating the development of unified
language-vision models. Recent efforts like LlamaGen have attempted
autoregressive image generation using discrete VQVAE tokens, but the large
number of tokens involved renders this approach inefficient and slow. In this
work, we present Meissonic, which elevates non-autoregressive masked image
modeling (MIM) text-to-image to a level comparable with state-of-the-art
diffusion models like SDXL. By incorporating a comprehensive suite of
architectural innovations, advanced positional encoding strategies, and
optimized sampling conditions, Meissonic substantially improves MIM's
performance and efficiency. Additionally, we leverage high-quality training
data, integrate micro-conditions informed by human preference scores, and
employ feature compression layers to further enhance image fidelity and
resolution. Our model not only matches but often exceeds the performance of
existing models like SDXL in generating high-quality, high-resolution images.
Extensive experiments validate Meissonic's capabilities, demonstrating its
potential as a new standard in text-to-image synthesis. We release a model
checkpoint capable of producing 1024 times 1024 resolution images.
Meissonic, a non-autoregressive masked image model, achieves high-quality image generation by incorporating advanced techniques and outperforms existing models like SDXL.
diffusion models Stable Diffusion autoregressive language models LlamaGen VQVAE tokens non-autoregressive masked image modeling (MIM) positional encoding strategies sampling conditions micro-conditions feature compression layers high-resolution images text-to-image synthesis