title: Understanding Generative AI Capabilities in Everyday Image Editing Tasks
summary: Generative AI (GenAI) holds significant promise for automating everyday image
  editing tasks, especially following the recent release of GPT-4o on March 25,
  2025. However, what subjects do people most often want edited? What kinds of
  editing actions do they want to perform (e.g., removing or stylizing the
  subject)? Do people prefer precise edits with predictable outcomes or highly
  creative ones? By understanding the characteristics of real-world requests and
  the corresponding edits made by freelance photo-editing wizards, can we draw
  lessons for improving AI-based editors and determine which types of requests
  can currently be handled successfully by AI editors? In this paper, we present
  a unique study addressing these questions by analyzing 83k requests from the
  past 12 years (2013-2025) on the Reddit community, which collected 305k
  PSR-wizard edits. According to human ratings, approximately only 33% of
  requests can be fulfilled by the best AI editors (including GPT-4o,
  Gemini-2.0-Flash, SeedEdit). Interestingly, AI editors perform worse on
  low-creativity requests that require precise editing than on more open-ended
  tasks. They often struggle to preserve the identity of people and animals, and
  frequently make non-requested touch-ups. On the other side of the table, VLM
  judges (e.g., o1) perform differently from human judges and may prefer AI edits
  more than human edits. Code and qualitative examples are available at:
  https://psrdataset.github.io
paper_authors._id: 682fddbd2b4a4d1ce53c5afb
paper_authors.name: Mohammad Reza Taesiri
paper_authors.status: extracted_confirmed
paper_authors.statusLastChangedAt: 2025-05-23T03:18:33.876Z
paper_authors._id: 6039478ab3ecf716b1a5fd4d
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/6039478ab3ecf716b1a5fd4d/_Thy4E7taiSYBLKxEKJbT.jpeg
paper_authors.fullname: taesiri
paper_authors.type: user
paper_authors.user: taesiri
paper_authors._id: 682fddbd2b4a4d1ce53c5afc
paper_authors.name: Brandon Collins
paper_authors.status: extracted_confirmed
paper_authors.statusLastChangedAt: 2025-05-23T02:32:10.307Z
paper_authors._id: 62c5947524171688a9feb992
paper_authors.avatarUrl: /avatars/5a151713b9eae8dc566f5957acee3475.svg
paper_authors.fullname: Franck Dernoncourt
paper_authors.type: user
paper_authors.user: Franck-Dernoncourt
paper_authors._id: 682fddbd2b4a4d1ce53c5afd
paper_authors.name: Logan Bolton
paper_authors.status: extracted_confirmed
paper_authors.statusLastChangedAt: 2025-05-23T02:33:14.731Z
paper_authors._id: 668c8e8c142f9b26a49f03cc
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/668c8e8c142f9b26a49f03cc/YNmPCrlsi6iwSeNfh1iID.png
paper_authors.fullname: Logan Bolton
paper_authors.type: user
paper_authors.user: loganbolton
paper_authors._id: 682fddbd2b4a4d1ce53c5afe
paper_authors.name: Viet Dac Lai
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-05-28T09:01:16.445Z
paper_authors._id: 63a0a29245edac9f75fc5d54
paper_authors.avatarUrl: /avatars/67ba006edfd1ceddc54ea920c09c972b.svg
paper_authors.fullname: Viet Lai
paper_authors.type: user
paper_authors.user: laiviet
paper_authors._id: 682fddbd2b4a4d1ce53c5aff
paper_authors.name: Franck Dernoncourt
paper_authors._id: 682fddbd2b4a4d1ce53c5b00
paper_authors.name: Trung Bui
paper_authors._id: 682fddbd2b4a4d1ce53c5b01
paper_authors.name: Anh Totti Nguyen
paper_title: Understanding Generative AI Capabilities in Everyday Image Editing Tasks
paper_summary: Generative AI (GenAI) holds significant promise for automating everyday image
  editing tasks, especially following the recent release of GPT-4o on March 25,
  2025. However, what subjects do people most often want edited? What kinds of
  editing actions do they want to perform (e.g., removing or stylizing the
  subject)? Do people prefer precise edits with predictable outcomes or highly
  creative ones? By understanding the characteristics of real-world requests and
  the corresponding edits made by freelance photo-editing wizards, can we draw
  lessons for improving AI-based editors and determine which types of requests
  can currently be handled successfully by AI editors? In this paper, we present
  a unique study addressing these questions by analyzing 83k requests from the
  past 12 years (2013-2025) on the Reddit community, which collected 305k
  PSR-wizard edits. According to human ratings, approximately only 33% of
  requests can be fulfilled by the best AI editors (including GPT-4o,
  Gemini-2.0-Flash, SeedEdit). Interestingly, AI editors perform worse on
  low-creativity requests that require precise editing than on more open-ended
  tasks. They often struggle to preserve the identity of people and animals, and
  frequently make non-requested touch-ups. On the other side of the table, VLM
  judges (e.g., o1) perform differently from human judges and may prefer AI edits
  more than human edits. Code and qualitative examples are available at:
  https://psrdataset.github.io
paper_ai_summary: Analysis of 83k image editing requests reveals that AI editors, including GPT-4o, struggle with low-creativity tasks and precise editing, while performing better on open-ended tasks, and human and VLM judges differ in their preferences for AI versus human edits.
paper_ai_keywords: GPT-4o Gemini-2.0-Flash SeedEdit VLM judges