FlashFace: Human Image Personalization with High-fidelity Identity
  Preservation
This work presents FlashFace, a practical tool with which users can easily
personalize their own photos on the fly by providing one or a few reference
face images and a text prompt. Our approach is distinguishable from existing
human photo customization methods by higher-fidelity identity preservation and
better instruction following, benefiting from two subtle designs. First, we
encode the face identity into a series of feature maps instead of one image
token as in prior arts, allowing the model to retain more details of the
reference faces (e.g., scars, tattoos, and face shape ). Second, we introduce a
disentangled integration strategy to balance the text and image guidance during
the text-to-image generation process, alleviating the conflict between the
reference faces and the text prompts (e.g., personalizing an adult into a
"child" or an "elder"). Extensive experimental results demonstrate the
effectiveness of our method on various applications, including human image
personalization, face swapping under language prompts, making virtual
characters into real people, etc. Project Page:
https://jshilong.github.io/flashface-page.
660246a29ff79e8cd51a0b59
Shilong Zhang
admin_assigned
2024-03-26T08:44:21.353Z
6424ffce46d202ad3d918a67
https://cdn-avatars.huggingface.co/v1/production/uploads/6424ffce46d202ad3d918a67/gmYmOA072fP_5cJLc9Qs4.jpeg
Shilong Zhang
user
shilongz
660246a29ff79e8cd51a0b5a
Lianghua Huang
admin_assigned
2024-03-26T08:45:08.529Z
640010d9fe6383d50b31b95f
/avatars/2e21587b123a813f84e43f1b1b2918c0.svg
Lianghua Huang
user
huanglianghua
660246a29ff79e8cd51a0b5b
Xi Chen
claimed_verified
2024-03-26T07:54:20.791Z
644a1b6401e18bf93a6f45c1
https://cdn-avatars.huggingface.co/v1/production/uploads/644a1b6401e18bf93a6f45c1/P0i_CgCrIzOS2tYRlxoE9.png
xichen
user
xichenhku
660246a29ff79e8cd51a0b5c
Yifei Zhang
660246a29ff79e8cd51a0b5d
Zhi-Fan Wu
admin_assigned
2024-03-26T08:46:49.177Z
64f0337e1dccbf71c3946204
/avatars/955d0533b4b7219773ef7b9a16c05848.svg
Wu Zhi-Fan
user
wuzhifan
660246a29ff79e8cd51a0b5e
Yutong Feng
admin_assigned
2024-03-26T08:47:05.029Z
64a54e468cfaa458bd6844bf
https://cdn-avatars.huggingface.co/v1/production/uploads/64a54e468cfaa458bd6844bf/5Gmf4tAr59GNl-2VaZDbu.png
Yutong Feng
user
fengyutong
660246a29ff79e8cd51a0b5f
Wei Wang
660246a29ff79e8cd51a0b60
Yujun Shen
660246a29ff79e8cd51a0b61
Yu Liu
admin_assigned
2024-03-26T08:48:23.626Z
636de85cc4a7a729c164d2b5
/avatars/3e281e547e1697e1c06805e7e63f3918.svg
Yu Liu
user
YuLiu
660246a29ff79e8cd51a0b62
Ping Luo
FlashFace: Human Image Personalization with High-fidelity Identity
  Preservation
This work presents FlashFace, a practical tool with which users can easily
personalize their own photos on the fly by providing one or a few reference
face images and a text prompt. Our approach is distinguishable from existing
human photo customization methods by higher-fidelity identity preservation and
better instruction following, benefiting from two subtle designs. First, we
encode the face identity into a series of feature maps instead of one image
token as in prior arts, allowing the model to retain more details of the
reference faces (e.g., scars, tattoos, and face shape ). Second, we introduce a
disentangled integration strategy to balance the text and image guidance during
the text-to-image generation process, alleviating the conflict between the
reference faces and the text prompts (e.g., personalizing an adult into a
"child" or an "elder"). Extensive experimental results demonstrate the
effectiveness of our method on various applications, including human image
personalization, face swapping under language prompts, making virtual
characters into real people, etc. Project Page:
https://jshilong.github.io/flashface-page.
FlashFace personalizes photos using face identity encoding into feature maps and disentangled integration of text and image guidance.
feature maps disentangled integration strategy text-to-image generation face swapping virtual characters real people