Jurassic World Remake: Bringing Ancient Fossils Back to Life via
  Zero-Shot Long Image-to-Image Translation
With a strong understanding of the target domain from natural language, we
produce promising results in translating across large domain gaps and bringing
skeletons back to life. In this work, we use text-guided latent diffusion
models for zero-shot image-to-image translation (I2I) across large domain gaps
(longI2I), where large amounts of new visual features and new geometry need to
be generated to enter the target domain. Being able to perform translations
across large domain gaps has a wide variety of real-world applications in
criminology, astrology, environmental conservation, and paleontology. In this
work, we introduce a new task Skull2Animal for translating between skulls and
living animals. On this task, we find that unguided Generative Adversarial
Networks (GANs) are not capable of translating across large domain gaps.
Instead of these traditional I2I methods, we explore the use of guided
diffusion and image editing models and provide a new benchmark model,
Revive-2I, capable of performing zero-shot I2I via text-prompting latent
diffusion models. We find that guidance is necessary for longI2I because, to
bridge the large domain gap, prior knowledge about the target domain is needed.
In addition, we find that prompting provides the best and most scalable
information about the target domain as classifier-guided diffusion models
require retraining for specific use cases and lack stronger constraints on the
target domain because of the wide variety of images they are trained on.
64db23c200b80a024c5ba9e2
Alexander Martin
claimed_verified
2023-08-16T13:22:33.801Z
644ffb154f731658826945c8
/avatars/46fa3a15c2b974692bee5b6ed6468be0.svg
Alex Martin
user
alexmartin1722
64db23c200b80a024c5ba9e3
Haitian Zheng
64db23c200b80a024c5ba9e4
Jie An
claimed_verified
2025-01-17T10:28:35.867Z
6267fb1387d7f9040e031d39
/avatars/c7170aa3d28d2cb851e075b98ca5f5b1.svg
Jie An
user
pkuanjie
64db23c200b80a024c5ba9e5
Jiebo Luo
Jurassic World Remake: Bringing Ancient Fossils Back to Life via
  Zero-Shot Long Image-to-Image Translation
With a strong understanding of the target domain from natural language, we
produce promising results in translating across large domain gaps and bringing
skeletons back to life. In this work, we use text-guided latent diffusion
models for zero-shot image-to-image translation (I2I) across large domain gaps
(longI2I), where large amounts of new visual features and new geometry need to
be generated to enter the target domain. Being able to perform translations
across large domain gaps has a wide variety of real-world applications in
criminology, astrology, environmental conservation, and paleontology. In this
work, we introduce a new task Skull2Animal for translating between skulls and
living animals. On this task, we find that unguided Generative Adversarial
Networks (GANs) are not capable of translating across large domain gaps.
Instead of these traditional I2I methods, we explore the use of guided
diffusion and image editing models and provide a new benchmark model,
Revive-2I, capable of performing zero-shot I2I via text-prompting latent
diffusion models. We find that guidance is necessary for longI2I because, to
bridge the large domain gap, prior knowledge about the target domain is needed.
In addition, we find that prompting provides the best and most scalable
information about the target domain as classifier-guided diffusion models
require retraining for specific use cases and lack stronger constraints on the
target domain because of the wide variety of images they are trained on.
A new zero-shot image-to-image translation method using text-guided latent diffusion models is introduced to bridge large domain gaps in translating between skulls and living animals.
text-guided latent diffusion models zero-shot image-to-image translation domain gaps Skull2Animal Generative Adversarial Networks (GANs) guided diffusion image editing models Revive-2I classifier-guided diffusion models