Illustrious: an Open Advanced Illustration Model
In this work, we share the insights for achieving state-of-the-art quality in
our text-to-image anime image generative model, called Illustrious. To achieve
high resolution, dynamic color range images, and high restoration ability, we
focus on three critical approaches for model improvement. First, we delve into
the significance of the batch size and dropout control, which enables faster
learning of controllable token based concept activations. Second, we increase
the training resolution of images, affecting the accurate depiction of
character anatomy in much higher resolution, extending its generation
capability over 20MP with proper methods. Finally, we propose the refined
multi-level captions, covering all tags and various natural language captions
as a critical factor for model development. Through extensive analysis and
experiments, Illustrious demonstrates state-of-the-art performance in terms of
animation style, outperforming widely-used models in illustration domains,
propelling easier customization and personalization with nature of open source.
We plan to publicly release updated Illustrious model series sequentially as
well as sustainable plans for improvements.
66fb911b028e0d22bc061206
Sang Hyun Park
admin_assigned
2024-10-02T08:52:39.216Z
6401c442f98fbc64bcd7ac1e
/avatars/94503db875a30cb843daca5bc20464ae.svg
Sang Hyun Park
user
andyp-nvidia
66fb911b028e0d22bc061207
Jun Young Koh
claimed_verified
2024-10-01T07:16:33.353Z
662b6b4c48b0b3742e533375
/avatars/691f270acac13d68b83248a7d0f7a7e8.svg
JUNYOUNG KOH
user
solbon1212
66fb911b028e0d22bc061208
Junha Lee
66fb911b028e0d22bc061209
Joy Song
claimed_verified
2024-10-15T13:39:47.453Z
670e69afc4364913e41dd918
/avatars/3cb4a22ce940a5c2fb1eca66912a7095.svg
Joy Song
user
fashiongirl9
66fb911b028e0d22bc06120a
Dongha Kim
66fb911b028e0d22bc06120b
Hoyeon Moon
admin_assigned
2024-10-02T08:55:06.114Z
651d27e3a00c49c5e50c0653
/avatars/2c62a11c0502e6887f1cba97f9e259a6.svg
Hoyeon Moon
user
mhy9910
66fb911b028e0d22bc06120c
Hyunju Lee
admin_assigned
2024-10-02T08:55:50.662Z
66e2bc2f0d7950a94e8d390f
/avatars/fae051c59518af1f121de468eab910a0.svg
Hyunju Lee
user
leehg57
66fb911b028e0d22bc06120d
Min Song
Illustrious: an Open Advanced Illustration Model
In this work, we share the insights for achieving state-of-the-art quality in
our text-to-image anime image generative model, called Illustrious. To achieve
high resolution, dynamic color range images, and high restoration ability, we
focus on three critical approaches for model improvement. First, we delve into
the significance of the batch size and dropout control, which enables faster
learning of controllable token based concept activations. Second, we increase
the training resolution of images, affecting the accurate depiction of
character anatomy in much higher resolution, extending its generation
capability over 20MP with proper methods. Finally, we propose the refined
multi-level captions, covering all tags and various natural language captions
as a critical factor for model development. Through extensive analysis and
experiments, Illustrious demonstrates state-of-the-art performance in terms of
animation style, outperforming widely-used models in illustration domains,
propelling easier customization and personalization with nature of open source.
We plan to publicly release updated Illustrious model series sequentially as
well as sustainable plans for improvements.
Illustrious, a text-to-image anime model, achieves high-resolution, dynamic color output, and strong restoration capabilities through controlled token activations, higher training resolutions, and refined multi-level captions, outperforming existing models.
controllable token based concept activations training resolution character anatomy refined multi-level captions state-of-the-art performance animation style illustration domains customization personalization