DreamO: A Unified Framework for Image Customization
Recently, extensive research on image customization (e.g., identity, subject,
style, background, etc.) demonstrates strong customization capabilities in
large-scale generative models. However, most approaches are designed for
specific tasks, restricting their generalizability to combine different types
of condition. Developing a unified framework for image customization remains an
open challenge. In this paper, we present DreamO, an image customization
framework designed to support a wide range of tasks while facilitating seamless
integration of multiple conditions. Specifically, DreamO utilizes a diffusion
transformer (DiT) framework to uniformly process input of different types.
During training, we construct a large-scale training dataset that includes
various customization tasks, and we introduce a feature routing constraint to
facilitate the precise querying of relevant information from reference images.
Additionally, we design a placeholder strategy that associates specific
placeholders with conditions at particular positions, enabling control over the
placement of conditions in the generated results. Moreover, we employ a
progressive training strategy consisting of three stages: an initial stage
focused on simple tasks with limited data to establish baseline consistency, a
full-scale training stage to comprehensively enhance the customization
capabilities, and a final quality alignment stage to correct quality biases
introduced by low-quality data. Extensive experiments demonstrate that the
proposed DreamO can effectively perform various image customization tasks with
high quality and flexibly integrate different types of control conditions.
6809b14111003e54bd204d99
Chong Mou
6809b14111003e54bd204d9a
Yanze Wu
claimed_verified
2025-04-24T09:10:24.617Z
639709c2be8a14bb9eeea8f6
/avatars/c142d71b541dccff91fcfd08a2cc0ce0.svg
Yanze Wu
user
yanze
6809b14111003e54bd204d9b
Wenxu Wu
6809b14111003e54bd204d9c
Zinan Guo
admin_assigned
2025-04-24T11:28:30.677Z
66b2e5f5523bf90aa7057467
/avatars/ccdb58c2e56cf861e9dcec50c85d7778.svg
Guo
user
Zinan123212
6809b14111003e54bd204d9d
Pengze Zhang
6809b14111003e54bd204d9e
Yufeng Cheng
claimed_verified
2025-05-13T08:13:16.597Z
66a0aed210de1ccd3d409721
/avatars/bc6e6c1d60b6601dfb3fe3a697e02ce9.svg
Yufeng Cheng
user
cb1cyf
6809b14111003e54bd204d9f
Yiming Luo
6809b14111003e54bd204da0
Fei Ding
6809b14111003e54bd204da1
Shiwen Zhang
admin_assigned
2025-04-24T11:32:47.326Z
64b7ef3af902508f0d8bf76d
/avatars/c3185cc11456a4575e19c62f1b50b41f.svg
Shiwen Zhang
user
shiwenzh
6809b14111003e54bd204da2
Xinghui Li
admin_assigned
2025-04-24T11:32:57.170Z
6752cd83ffaeeb979db974ae
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/ci915Tdmv3uWbCqGy7LqL.png
Xinghui Li
user
Crayon-Shinchan
6809b14111003e54bd204da3
Mengtian Li
admin_assigned
2025-04-24T11:33:22.554Z
6805bdfb344d6d8a8fd5b07a
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/dGLeWvN2CXLmxVP_b9S4R.png
Mengtian Li
user
LemonSky1995
6809b14111003e54bd204da4
Songtao Zhao
6809b14111003e54bd204da5
Jian Zhang
6809b14111003e54bd204da6
Qian He
6809b14111003e54bd204da7
Xinglong Wu
admin_assigned
2025-04-24T11:29:20.661Z
67bc6b515d9470ec64bdcc33
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/dttL8Fb3bKCVG5zjg_02q.png
Xinglong Wu
user
Xingzhe-xlwu
DreamO: A Unified Framework for Image Customization
Recently, extensive research on image customization (e.g., identity, subject,
style, background, etc.) demonstrates strong customization capabilities in
large-scale generative models. However, most approaches are designed for
specific tasks, restricting their generalizability to combine different types
of condition. Developing a unified framework for image customization remains an
open challenge. In this paper, we present DreamO, an image customization
framework designed to support a wide range of tasks while facilitating seamless
integration of multiple conditions. Specifically, DreamO utilizes a diffusion
transformer (DiT) framework to uniformly process input of different types.
During training, we construct a large-scale training dataset that includes
various customization tasks, and we introduce a feature routing constraint to
facilitate the precise querying of relevant information from reference images.
Additionally, we design a placeholder strategy that associates specific
placeholders with conditions at particular positions, enabling control over the
placement of conditions in the generated results. Moreover, we employ a
progressive training strategy consisting of three stages: an initial stage
focused on simple tasks with limited data to establish baseline consistency, a
full-scale training stage to comprehensively enhance the customization
capabilities, and a final quality alignment stage to correct quality biases
introduced by low-quality data. Extensive experiments demonstrate that the
proposed DreamO can effectively perform various image customization tasks with
high quality and flexibly integrate different types of control conditions.
DreamO, an image customization framework using diffusion transformers, supports various tasks and integrates multiple conditions through a unified approach.
diffusion transformer DiT feature routing constraint placeholder strategy progressive training strategy baseline consistency full-scale training quality alignment stage quality biases