title: DreamBench++: A Human-Aligned Benchmark for Personalized Image
    Generation
summary: Personalized image generation holds great promise in assisting humans in
  everyday work and life due to its impressive function in creatively generating
  personalized content. However, current evaluations either are automated but
  misalign with humans or require human evaluations that are time-consuming and
  expensive. In this work, we present DreamBench++, a human-aligned benchmark
  automated by advanced multimodal GPT models. Specifically, we systematically
  design the prompts to let GPT be both human-aligned and self-aligned, empowered
  with task reinforcement. Further, we construct a comprehensive dataset
  comprising diverse images and prompts. By benchmarking 7 modern generative
  models, we demonstrate that DreamBench++ results in significantly more
  human-aligned evaluation, helping boost the community with innovative findings.
paper_authors._id: 667a2da1d25dfd6fef20d30b
paper_authors.name: Yuang Peng
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-06-25T07:33:16.296Z
paper_authors._id: 631ee086c1a8269da39265c6
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/631ee086c1a8269da39265c6/wUa1epGtTGcUv2mvrLUcD.png
paper_authors.fullname: Yuang Peng
paper_authors.type: user
paper_authors.user: yuangpeng
paper_authors._id: 667a2da1d25dfd6fef20d30c
paper_authors.name: Yuxin Cui
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-06-26T08:05:06.157Z
paper_authors._id: 655f17215afa950b64de6788
paper_authors.avatarUrl: /avatars/a6a5f9769c03579fa686ae5aa1912002.svg
paper_authors.fullname: cyx
paper_authors.type: user
paper_authors.user: cyxbest
paper_authors._id: 667a2da1d25dfd6fef20d30d
paper_authors.name: Haomiao Tang
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-06-25T07:48:11.274Z
paper_authors._id: 62bafb8668bc5c82747b3cf9
paper_authors.avatarUrl: /avatars/21b1dadeaa7ee2ca2be7150c8a8c27c3.svg
paper_authors.fullname: Haomiao Tang
paper_authors.type: user
paper_authors.user: Me0W
paper_authors._id: 667a2da1d25dfd6fef20d30e
paper_authors.name: Zekun Qi
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-06-25T07:48:19.255Z
paper_authors._id: 63c3e8abc7d7f4c63a515a02
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/63c3e8abc7d7f4c63a515a02/npMHnVP2hHLbvoUGe7C4O.jpeg
paper_authors.fullname: Zekun Qi
paper_authors.type: user
paper_authors.user: qizekun
paper_authors._id: 667a2da1d25dfd6fef20d30f
paper_authors.name: Runpei Dong
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-06-25T07:33:18.443Z
paper_authors._id: 6201fc5d91d53938a6432fbf
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/6201fc5d91d53938a6432fbf/VLs8ZYaZrop4KBpZn53fH.jpeg
paper_authors.fullname: Runpei Dong
paper_authors.type: user
paper_authors.user: RunpeiDong
paper_authors._id: 667a2da1d25dfd6fef20d310
paper_authors.name: Jing Bai
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-06-25T07:48:34.002Z
paper_authors._id: 65b291bbda72b2526d05a54c
paper_authors.avatarUrl: /avatars/ac873a2bf07349386f88e085f9c16ad7.svg
paper_authors.fullname: baijing
paper_authors.type: user
paper_authors.user: baijing163
paper_authors._id: 667a2da1d25dfd6fef20d311
paper_authors.name: Chunrui Han
paper_authors._id: 667a2da1d25dfd6fef20d312
paper_authors.name: Zheng Ge
paper_authors._id: 667a2da1d25dfd6fef20d313
paper_authors.name: Xiangyu Zhang
paper_authors._id: 667a2da1d25dfd6fef20d314
paper_authors.name: Shu-Tao Xia
paper_title: DreamBench++: A Human-Aligned Benchmark for Personalized Image
    Generation
paper_summary: Personalized image generation holds great promise in assisting humans in
  everyday work and life due to its impressive function in creatively generating
  personalized content. However, current evaluations either are automated but
  misalign with humans or require human evaluations that are time-consuming and
  expensive. In this work, we present DreamBench++, a human-aligned benchmark
  automated by advanced multimodal GPT models. Specifically, we systematically
  design the prompts to let GPT be both human-aligned and self-aligned, empowered
  with task reinforcement. Further, we construct a comprehensive dataset
  comprising diverse images and prompts. By benchmarking 7 modern generative
  models, we demonstrate that DreamBench++ results in significantly more
  human-aligned evaluation, helping boost the community with innovative findings.