GHOST 2.0: generative high-fidelity one shot transfer of heads
While the task of face swapping has recently gained attention in the research
community, a related problem of head swapping remains largely unexplored. In
addition to skin color transfer, head swap poses extra challenges, such as the
need to preserve structural information of the whole head during synthesis and
inpaint gaps between swapped head and background. In this paper, we address
these concerns with GHOST 2.0, which consists of two problem-specific modules.
First, we introduce enhanced Aligner model for head reenactment, which
preserves identity information at multiple scales and is robust to extreme pose
variations. Secondly, we use a Blender module that seamlessly integrates the
reenacted head into the target background by transferring skin color and
inpainting mismatched regions. Both modules outperform the baselines on the
corresponding tasks, allowing to achieve state of the art results in head
swapping. We also tackle complex cases, such as large difference in hair styles
of source and target. Code is available at
https://github.com/ai-forever/ghost-2.0
67c02b2eb14cf3cbc800c292
Alexander Groshev
67c02b2eb14cf3cbc800c293
Anastasiia Iashchenko
claimed_verified
2025-02-27T09:13:49.896Z
67aafccd7517c92ba71142f2
/avatars/ef4b5c6867250b8b7af2c995dd7ad740.svg
Anastasiia Iashchenko
user
nastasia-y
67c02b2eb14cf3cbc800c294
Pavel Paramonov
67c02b2eb14cf3cbc800c295
Denis Dimitrov
claimed_verified
2025-02-27T12:54:35.272Z
6669a678465d1d802181e456
https://cdn-avatars.huggingface.co/v1/production/uploads/6669a678465d1d802181e456/ZCthBBhDFQnh0bBkgUQUU.png
Denis Dimitrov
user
dendimitrov
67c02b2eb14cf3cbc800c296
Andrey Kuznetsov
claimed_verified
2025-02-27T12:54:37.211Z
643984dceb7c5616ef3f5d54
https://cdn-avatars.huggingface.co/v1/production/uploads/643984dceb7c5616ef3f5d54/10JRkblrRIEVci6UJwvPz.jpeg
Andrey Kuznetsov
user
kuznetsoffandrey
GHOST 2.0: generative high-fidelity one shot transfer of heads
While the task of face swapping has recently gained attention in the research
community, a related problem of head swapping remains largely unexplored. In
addition to skin color transfer, head swap poses extra challenges, such as the
need to preserve structural information of the whole head during synthesis and
inpaint gaps between swapped head and background. In this paper, we address
these concerns with GHOST 2.0, which consists of two problem-specific modules.
First, we introduce enhanced Aligner model for head reenactment, which
preserves identity information at multiple scales and is robust to extreme pose
variations. Secondly, we use a Blender module that seamlessly integrates the
reenacted head into the target background by transferring skin color and
inpainting mismatched regions. Both modules outperform the baselines on the
corresponding tasks, allowing to achieve state of the art results in head
swapping. We also tackle complex cases, such as large difference in hair styles
of source and target. Code is available at
https://github.com/ai-forever/ghost-2.0
GHOST 2.0, consisting of an Aligner and Blender module, achieves state-of-the-art results in head swapping by preserving identity information, handling extreme poses, and seamlessly integrating the reenacted head into the target background.
Aligner Blender head reenactment skin color transfer inpainting identity information extreme pose variations