Show-o: One Single Transformer to Unify Multimodal Understanding and
  Generation
We present a unified transformer, i.e., Show-o, that unifies multimodal
understanding and generation. Unlike fully autoregressive models, Show-o
unifies autoregressive and (discrete) diffusion modeling to adaptively handle
inputs and outputs of various and mixed modalities. The unified model flexibly
supports a wide range of vision-language tasks including visual
question-answering, text-to-image generation, text-guided
inpainting/extrapolation, and mixed-modality generation. Across various
benchmarks, it demonstrates comparable or superior performance to existing
individual models with an equivalent or larger number of parameters tailored
for understanding or generation. This significantly highlights its potential as
a next-generation foundation model. Code and models are released at
https://github.com/showlab/Show-o.
66c7fffaac77b1ccf9f43d04
Jinheng Xie
claimed_verified
2025-06-19T09:11:56.686Z
64731de50da364bd0dfb7cd0
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/6DTmh7MOemA6xYMWGY9Ce.jpeg
Jinheng Xie
user
Sierkinhane
66c7fffaac77b1ccf9f43d05
Weijia Mao
66c7fffaac77b1ccf9f43d06
Zechen Bai
claimed_verified
2024-10-01T07:16:56.506Z
64b7833aa5018e3c7c9b50d8
/avatars/782415605ed786b73f484fcc86a6384f.svg
Zechen Bai
user
ZechenBai
66c7fffaac77b1ccf9f43d07
David Junhao Zhang
66c7fffaac77b1ccf9f43d08
Weihao Wang
66c7fffaac77b1ccf9f43d09
Kevin Qinghong Lin
66c7fffaac77b1ccf9f43d0a
Yuchao Gu
66c7fffaac77b1ccf9f43d0b
Zhijie Chen
66c7fffaac77b1ccf9f43d0c
Zhenheng Yang
66c7fffaac77b1ccf9f43d0d
Mike Zheng Shou
Show-o: One Single Transformer to Unify Multimodal Understanding and
  Generation
We present a unified transformer, i.e., Show-o, that unifies multimodal
understanding and generation. Unlike fully autoregressive models, Show-o
unifies autoregressive and (discrete) diffusion modeling to adaptively handle
inputs and outputs of various and mixed modalities. The unified model flexibly
supports a wide range of vision-language tasks including visual
question-answering, text-to-image generation, text-guided
inpainting/extrapolation, and mixed-modality generation. Across various
benchmarks, it demonstrates comparable or superior performance to existing
individual models with an equivalent or larger number of parameters tailored
for understanding or generation. This significantly highlights its potential as
a next-generation foundation model. Code and models are released at
https://github.com/showlab/Show-o.
Show-o, a unified transformer model, combines autoregressive and diffusion modeling for versatile vision-language tasks, achieving competitive performance.
unified transformer autoregressive models diffusion modeling multimodal understanding visual question-answering text-to-image generation text-guided inpainting/extrapolation mixed-modality generation foundation model