title: ViStoryBench: Comprehensive Benchmark Suite for Story Visualization
summary: Story visualization, which aims to generate a sequence of visually coherent
  images aligning with a given narrative and reference images, has seen
  significant progress with recent advancements in generative models. To further
  enhance the performance of story visualization frameworks in real-world
  scenarios, we introduce a comprehensive evaluation benchmark, ViStoryBench. We
  collect a diverse dataset encompassing various story types and artistic styles,
  ensuring models are evaluated across multiple dimensions such as different
  plots (e.g., comedy, horror) and visual aesthetics (e.g., anime, 3D
  renderings). ViStoryBench is carefully curated to balance narrative structures
  and visual elements, featuring stories with single and multiple protagonists to
  test models' ability to maintain character consistency. Additionally, it
  includes complex plots and intricate world-building to challenge models in
  generating accurate visuals. To ensure comprehensive comparisons, our benchmark
  incorporates a wide range of evaluation metrics assessing critical aspects.
  This structured and multifaceted framework enables researchers to thoroughly
  identify both the strengths and weaknesses of different models, fostering
  targeted improvements.
paper_authors._id: 683d54f364b44c0ccabb9e65
paper_authors.name: Cailin Zhuang
paper_authors._id: 683d54f364b44c0ccabb9e66
paper_authors.name: Ailin Huang
paper_authors._id: 683d54f364b44c0ccabb9e67
paper_authors.name: Wei Cheng
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-06-02T07:40:49.393Z
paper_authors._id: 64b914c8ace99c0723ad83a9
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/64b914c8ace99c0723ad83a9/B4gxNByeVY_xaOcjwiN1j.jpeg
paper_authors.fullname: Wei Cheng
paper_authors.type: user
paper_authors.user: wchengad
paper_authors._id: 683d54f364b44c0ccabb9e68
paper_authors.name: Jingwei Wu
paper_authors._id: 683d54f364b44c0ccabb9e69
paper_authors.name: Yaoqi Hu
paper_authors._id: 683d54f364b44c0ccabb9e6a
paper_authors.name: Jiaqi Liao
paper_authors._id: 683d54f364b44c0ccabb9e6b
paper_authors.name: Zhewei Huang
paper_authors._id: 683d54f364b44c0ccabb9e6c
paper_authors.name: Hongyuan Wang
paper_authors._id: 683d54f364b44c0ccabb9e6d
paper_authors.name: Xinyao Liao
paper_authors._id: 683d54f364b44c0ccabb9e6e
paper_authors.name: Weiwei Cai
paper_authors._id: 683d54f364b44c0ccabb9e6f
paper_authors.name: Hengyuan Xu
paper_authors._id: 683d54f364b44c0ccabb9e70
paper_authors.name: Xuanyang Zhang
paper_authors._id: 683d54f364b44c0ccabb9e71
paper_authors.name: Xianfang Zeng
paper_authors._id: 683d54f364b44c0ccabb9e72
paper_authors.name: Gang Yu
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-06-04T09:03:17.238Z
paper_authors._id: 63417332c5565a4b8d43a0d8
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/63417332c5565a4b8d43a0d8/MmnYG7Wu2Z_lqCBvTfJmy.png
paper_authors.fullname: Gang Yu
paper_authors.type: user
paper_authors.user: skicy
paper_authors._id: 683d54f364b44c0ccabb9e73
paper_authors.name: Chi Zhang
paper_title: ViStoryBench: Comprehensive Benchmark Suite for Story Visualization
paper_summary: Story visualization, which aims to generate a sequence of visually coherent
  images aligning with a given narrative and reference images, has seen
  significant progress with recent advancements in generative models. To further
  enhance the performance of story visualization frameworks in real-world
  scenarios, we introduce a comprehensive evaluation benchmark, ViStoryBench. We
  collect a diverse dataset encompassing various story types and artistic styles,
  ensuring models are evaluated across multiple dimensions such as different
  plots (e.g., comedy, horror) and visual aesthetics (e.g., anime, 3D
  renderings). ViStoryBench is carefully curated to balance narrative structures
  and visual elements, featuring stories with single and multiple protagonists to
  test models' ability to maintain character consistency. Additionally, it
  includes complex plots and intricate world-building to challenge models in
  generating accurate visuals. To ensure comprehensive comparisons, our benchmark
  incorporates a wide range of evaluation metrics assessing critical aspects.
  This structured and multifaceted framework enables researchers to thoroughly
  identify both the strengths and weaknesses of different models, fostering
  targeted improvements.
paper_ai_summary: ViStoryBench is a comprehensive evaluation benchmark for story visualization frameworks, featuring diverse datasets and metrics to assess model performance across narrative and visual dimensions.
paper_ai_keywords: generative models story visualization evaluation benchmark diverse dataset plots visual aesthetics narrative structures visual elements character consistency complex plots world-building evaluation metrics