title: FlexEdit: Flexible and Controllable Diffusion-based Object-centric Image
    Editing
summary: Our work addresses limitations seen in previous approaches for object-centric
  editing problems, such as unrealistic results due to shape discrepancies and
  limited control in object replacement or insertion. To this end, we introduce
  FlexEdit, a flexible and controllable editing framework for objects where we
  iteratively adjust latents at each denoising step using our FlexEdit block.
  Initially, we optimize latents at test time to align with specified object
  constraints. Then, our framework employs an adaptive mask, automatically
  extracted during denoising, to protect the background while seamlessly blending
  new content into the target image. We demonstrate the versatility of FlexEdit
  in various object editing tasks and curate an evaluation test suite with
  samples from both real and synthetic images, along with novel evaluation
  metrics designed for object-centric editing. We conduct extensive experiments
  on different editing scenarios, demonstrating the superiority of our editing
  framework over recent advanced text-guided image editing methods. Our project
  page is published at https://flex-edit.github.io/.
paper_authors._id: 6604e02369c47cd78fde0c3a
paper_authors.name: Trong-Tung Nguyen
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-03-28T16:39:43.587Z
paper_authors._id: 640052b2f4ff62c2616af567
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/640052b2f4ff62c2616af567/PmMNDQtSgdJ_74IFoYdpp.jpeg
paper_authors.fullname: NGUYEN TRONG TUNG
paper_authors.type: user
paper_authors.user: Tung11
paper_authors._id: 6604e02369c47cd78fde0c3b
paper_authors.name: Duc-Anh Nguyen
paper_authors._id: 6604e02369c47cd78fde0c3c
paper_authors.name: Anh Tran
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-12-05T09:30:06.052Z
paper_authors._id: 63e9fc6174f940d171e4c5e9
paper_authors.avatarUrl: /avatars/0c34fdaecd7bd8aaffb3d68e83c0eeaf.svg
paper_authors.fullname: Anh Tran
paper_authors.type: user
paper_authors.user: anhttran1111
paper_authors._id: 6604e02369c47cd78fde0c3d
paper_authors.name: Cuong Pham
paper_title: FlexEdit: Flexible and Controllable Diffusion-based Object-centric Image
    Editing
paper_summary: Our work addresses limitations seen in previous approaches for object-centric
  editing problems, such as unrealistic results due to shape discrepancies and
  limited control in object replacement or insertion. To this end, we introduce
  FlexEdit, a flexible and controllable editing framework for objects where we
  iteratively adjust latents at each denoising step using our FlexEdit block.
  Initially, we optimize latents at test time to align with specified object
  constraints. Then, our framework employs an adaptive mask, automatically
  extracted during denoising, to protect the background while seamlessly blending
  new content into the target image. We demonstrate the versatility of FlexEdit
  in various object editing tasks and curate an evaluation test suite with
  samples from both real and synthetic images, along with novel evaluation
  metrics designed for object-centric editing. We conduct extensive experiments
  on different editing scenarios, demonstrating the superiority of our editing
  framework over recent advanced text-guided image editing methods. Our project
  page is published at https://flex-edit.github.io/.
paper_ai_keywords: FlexEdit latents denoising step FlexEdit block object constraints adaptive mask background protection object-centric editing evaluation metrics text-guided image editing methods