CSGO: Content-Style Composition in Text-to-Image Generation
The diffusion model has shown exceptional capabilities in controlled image
generation, which has further fueled interest in image style transfer. Existing
works mainly focus on training free-based methods (e.g., image inversion) due
to the scarcity of specific data. In this study, we present a data construction
pipeline for content-style-stylized image triplets that generates and
automatically cleanses stylized data triplets. Based on this pipeline, we
construct a dataset IMAGStyle, the first large-scale style transfer dataset
containing 210k image triplets, available for the community to explore and
research. Equipped with IMAGStyle, we propose CSGO, a style transfer model
based on end-to-end training, which explicitly decouples content and style
features employing independent feature injection. The unified CSGO implements
image-driven style transfer, text-driven stylized synthesis, and text
editing-driven stylized synthesis. Extensive experiments demonstrate the
effectiveness of our approach in enhancing style control capabilities in image
generation. Additional visualization and access to the source code can be
located on the project page: https://csgo-gen.github.io/.
66d126452ba3de746a831367
Peng Xing
claimed_verified
2024-08-30T07:17:59.868Z
649f7b742bf2e21d955c1067
/avatars/270026405d5640886a86f961a001b057.svg
xing
user
xingpng
66d126452ba3de746a831368
Haofan Wang
extracted_confirmed
2024-10-30T09:37:34.951Z
637745113a63a2983ffbde13
https://cdn-avatars.huggingface.co/v1/production/uploads/1669187672174-637745113a63a2983ffbde13.jpeg
Haofan Wang
user
wanghaofan
66d126452ba3de746a831369
Yanpeng Sun
admin_assigned
2024-08-30T09:04:22.878Z
64297212e5f33939cf3a3d9b
/avatars/bd21759ab5d7e526b99fcb7ed813ffb3.svg
yanpeng_sun
user
syp115
66d126452ba3de746a83136a
Qixun Wang
admin_assigned
2024-08-30T09:04:29.075Z
65e2e93bfcaff433f7a87b43
/avatars/020e008a6a748df75227c51f331d3bce.svg
Qixun Wang
user
NOVAglow646
66d126452ba3de746a83136b
Xu Bai
66d126452ba3de746a83136c
Hao Ai
claimed_verified
2024-09-02T07:18:58.708Z
6464d47c07a7f745c59ce7f4
https://cdn-avatars.huggingface.co/v1/production/uploads/6464d47c07a7f745c59ce7f4/6mOib8MSaQ5RejmJboIya.jpeg
aihao2000
user
AisingioroHao0
66d126452ba3de746a83136d
Renyuan Huang
claimed_verified
2024-10-21T07:55:58.127Z
63fb06691b4b1bd4e7fb3e03
/avatars/78f3dda51014b40cfd42f6860cb90fc4.svg
Jen-Yuan Huang
user
JOY-Huang
66d126452ba3de746a83136e
Zechao Li
CSGO: Content-Style Composition in Text-to-Image Generation
The diffusion model has shown exceptional capabilities in controlled image
generation, which has further fueled interest in image style transfer. Existing
works mainly focus on training free-based methods (e.g., image inversion) due
to the scarcity of specific data. In this study, we present a data construction
pipeline for content-style-stylized image triplets that generates and
automatically cleanses stylized data triplets. Based on this pipeline, we
construct a dataset IMAGStyle, the first large-scale style transfer dataset
containing 210k image triplets, available for the community to explore and
research. Equipped with IMAGStyle, we propose CSGO, a style transfer model
based on end-to-end training, which explicitly decouples content and style
features employing independent feature injection. The unified CSGO implements
image-driven style transfer, text-driven stylized synthesis, and text
editing-driven stylized synthesis. Extensive experiments demonstrate the
effectiveness of our approach in enhancing style control capabilities in image
generation. Additional visualization and access to the source code can be
located on the project page: https://csgo-gen.github.io/.
A data construction pipeline and dataset called IMAGStyle enable a style transfer model named CSGO to enhance style control in image generation through end-to-end training and independent feature injection.
diffusion model image style transfer data construction pipeline content-style-stylized image triplets IMAGStyle style transfer model CSGO end-to-end training feature injection image-driven style transfer text-driven stylized synthesis text editing-driven stylized synthesis