RealFill: Reference-Driven Generation for Authentic Image Completion
Recent advances in generative imagery have brought forth outpainting and
inpainting models that can produce high-quality, plausible image content in
unknown regions, but the content these models hallucinate is necessarily
inauthentic, since the models lack sufficient context about the true scene. In
this work, we propose RealFill, a novel generative approach for image
completion that fills in missing regions of an image with the content that
should have been there. RealFill is a generative inpainting model that is
personalized using only a few reference images of a scene. These reference
images do not have to be aligned with the target image, and can be taken with
drastically varying viewpoints, lighting conditions, camera apertures, or image
styles. Once personalized, RealFill is able to complete a target image with
visually compelling contents that are faithful to the original scene. We
evaluate RealFill on a new image completion benchmark that covers a set of
diverse and challenging scenarios, and find that it outperforms existing
approaches by a large margin. See more results on our project page:
https://realfill.github.io
65163399a546159af98e463f
Luming Tang
claimed_verified
2023-10-02T06:59:52.224Z
63e495a99db5da2dc1f679df
/avatars/e3b3f7702a5c8fd21a246272940e45b8.svg
Luming Tang
user
lt453
65163399a546159af98e4640
Nataniel Ruiz
claimed_verified
2023-10-05T06:34:27.020Z
6318c6e6cb116eab31d70a16
https://cdn-avatars.huggingface.co/v1/production/uploads/6318c6e6cb116eab31d70a16/yAw5XtvqaPUkPj2B6JOzz.jpeg
Nataniel
user
flavoredquark
65163399a546159af98e4641
Qinghao Chu
65163399a546159af98e4642
Yuanzhen Li
admin_assigned
2023-09-29T12:06:54.260Z
6334ee5831a2be3938c85639
/avatars/9821af26a585f54b595ec39f061f2250.svg
Yuanzhen Li
user
yzli
65163399a546159af98e4643
Aleksander Holynski
admin_assigned
2023-09-29T12:06:39.178Z
62f6e2792e53c2efd33faa92
/avatars/85d94b4022577747b8d2d10a82c2f3c7.svg
Aleksander Holynski
user
holynski
65163399a546159af98e4644
David E. Jacobs
65163399a546159af98e4645
Bharath Hariharan
admin_assigned
2023-09-29T12:05:51.897Z
64de7f10d7605441a8b348b2
/avatars/177b5b386b416344dca325af185fb2c6.svg
Bharath Hariharan
user
bharathh
65163399a546159af98e4646
Yael Pritch
65163399a546159af98e4647
Neal Wadhwa
admin_assigned
2023-09-29T12:05:33.067Z
63041bb6eedc089484c82ed3
/avatars/fca4b823f748cde5f5cff1212213523d.svg
Neal Wadhwa
user
NealWadhwa
65163399a546159af98e4648
Kfir Aberman
65163399a546159af98e4649
Michael Rubinstein
RealFill: Reference-Driven Generation for Authentic Image Completion
Recent advances in generative imagery have brought forth outpainting and
inpainting models that can produce high-quality, plausible image content in
unknown regions, but the content these models hallucinate is necessarily
inauthentic, since the models lack sufficient context about the true scene. In
this work, we propose RealFill, a novel generative approach for image
completion that fills in missing regions of an image with the content that
should have been there. RealFill is a generative inpainting model that is
personalized using only a few reference images of a scene. These reference
images do not have to be aligned with the target image, and can be taken with
drastically varying viewpoints, lighting conditions, camera apertures, or image
styles. Once personalized, RealFill is able to complete a target image with
visually compelling contents that are faithful to the original scene. We
evaluate RealFill on a new image completion benchmark that covers a set of
diverse and challenging scenarios, and find that it outperforms existing
approaches by a large margin. See more results on our project page:
https://realfill.github.io
RealFill is a personalized generative inpainting model that fills in missing parts of images with content faithful to the original scene using a few reference images.
generative imagery outpainting inpainting RealFill generative inpainting model image completion benchmark