title: BlobCtrl: A Unified and Flexible Framework for Element-level Image
    Generation and Editing
summary: Element-level visual manipulation is essential in digital content creation,
  but current diffusion-based methods lack the precision and flexibility of
  traditional tools. In this work, we introduce BlobCtrl, a framework that
  unifies element-level generation and editing using a probabilistic blob-based
  representation. By employing blobs as visual primitives, our approach
  effectively decouples and represents spatial location, semantic content, and
  identity information, enabling precise element-level manipulation. Our key
  contributions include: 1) a dual-branch diffusion architecture with
  hierarchical feature fusion for seamless foreground-background integration; 2)
  a self-supervised training paradigm with tailored data augmentation and score
  functions; and 3) controllable dropout strategies to balance fidelity and
  diversity. To support further research, we introduce BlobData for large-scale
  training and BlobBench for systematic evaluation. Experiments show that
  BlobCtrl excels in various element-level manipulation tasks while maintaining
  computational efficiency, offering a practical solution for precise and
  flexible visual content creation. Project page:
  https://liyaowei-stu.github.io/project/BlobCtrl/
paper_authors._id: 67d916b500030726e0df2a67
paper_authors.name: Yaowei Li
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-18T09:23:48.215Z
paper_authors._id: 6362801380c1a705a6ea54ac
paper_authors.avatarUrl: /avatars/041ad5abf9be42e336938f51ebb8746c.svg
paper_authors.fullname: Yaowei Li
paper_authors.type: user
paper_authors.user: Yw22
paper_authors._id: 67d916b500030726e0df2a68
paper_authors.name: Lingen Li
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-18T09:23:54.498Z
paper_authors._id: 66837d3c48edefb453b0640a
paper_authors.avatarUrl: /avatars/b16385eaa612578728e2c6460a76b38f.svg
paper_authors.fullname: Lingen Li
paper_authors.type: user
paper_authors.user: l-li
paper_authors._id: 67d916b500030726e0df2a69
paper_authors.name: Zhaoyang Zhang
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-03-18T08:07:22.583Z
paper_authors._id: 658409ceca19ccf6d9989add
paper_authors.avatarUrl: /avatars/3ac1dbd25e52435185babdeb3da28875.svg
paper_authors.fullname: Zhaoyang Zhang
paper_authors.type: user
paper_authors.user: ZyZcuhk
paper_authors._id: 67d916b500030726e0df2a6a
paper_authors.name: Xiaoyu Li
paper_authors._id: 67d916b500030726e0df2a6b
paper_authors.name: Guangzhi Wang
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-18T09:24:18.787Z
paper_authors._id: 6422b973ef9e8971003cdd22
paper_authors.avatarUrl: /avatars/8564a2e984e2e79e46d90cc9c35e5773.svg
paper_authors.fullname: Guangzhi Wang
paper_authors.type: user
paper_authors.user: daoyuan98
paper_authors._id: 67d916b500030726e0df2a6c
paper_authors.name: Hongxiang Li
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-18T09:24:25.700Z
paper_authors._id: 653eb3bd4a52f10eaf72fbaf
paper_authors.avatarUrl: /avatars/b525482b61c6f6054bf44bbc3113c29f.svg
paper_authors.fullname: Hongxiang Li
paper_authors.type: user
paper_authors.user: HongxiangLi
paper_authors._id: 67d916b500030726e0df2a6d
paper_authors.name: Xiaodong Cun
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-18T09:24:32.118Z
paper_authors._id: 63184c517ca1b876d99b7e0e
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/63184c517ca1b876d99b7e0e/b-qDExoeJuDXK0cJBZKnz.jpeg
paper_authors.fullname: Xiaodong Cun
paper_authors.type: user
paper_authors.user: vinthony
paper_authors._id: 67d916b500030726e0df2a6e
paper_authors.name: Ying Shan
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-18T09:24:39.725Z
paper_authors._id: 63ca3ddc04c979828310bfcb
paper_authors.avatarUrl: /avatars/615e0d8622950b4408b40d550f02a894.svg
paper_authors.fullname: Ying Shan
paper_authors.type: user
paper_authors.user: yshan2u
paper_authors._id: 67d916b500030726e0df2a6f
paper_authors.name: Yuexian Zou
paper_title: BlobCtrl: A Unified and Flexible Framework for Element-level Image
    Generation and Editing
paper_summary: Element-level visual manipulation is essential in digital content creation,
  but current diffusion-based methods lack the precision and flexibility of
  traditional tools. In this work, we introduce BlobCtrl, a framework that
  unifies element-level generation and editing using a probabilistic blob-based
  representation. By employing blobs as visual primitives, our approach
  effectively decouples and represents spatial location, semantic content, and
  identity information, enabling precise element-level manipulation. Our key
  contributions include: 1) a dual-branch diffusion architecture with
  hierarchical feature fusion for seamless foreground-background integration; 2)
  a self-supervised training paradigm with tailored data augmentation and score
  functions; and 3) controllable dropout strategies to balance fidelity and
  diversity. To support further research, we introduce BlobData for large-scale
  training and BlobBench for systematic evaluation. Experiments show that
  BlobCtrl excels in various element-level manipulation tasks while maintaining
  computational efficiency, offering a practical solution for precise and
  flexible visual content creation. Project page:
  https://liyaowei-stu.github.io/project/BlobCtrl/
paper_ai_summary: BlobCtrl is a framework that uses a probabilistic blob-based representation for element-level generation and editing, offering precision and flexibility through a dual-branch diffusion architecture, self-supervised training, and controllable dropout strategies.
paper_ai_keywords: diffusion-based methods probabilistic blob-based representation dual-branch diffusion architecture hierarchical feature fusion foreground-background integration self-supervised training tailored data augmentation score functions controllable dropout strategies BlobData BlobBench