title: SBS Figures: Pre-training Figure QA from Stage-by-Stage Synthesized
    Images
summary: Building a large-scale figure QA dataset requires a considerable amount of
  work, from gathering and selecting figures to extracting attributes like text,
  numbers, and colors, and generating QAs. Although recent developments in LLMs
  have led to efforts to synthesize figures, most of these focus primarily on QA
  generation. Additionally, creating figures directly using LLMs often encounters
  issues such as code errors, similar-looking figures, and repetitive content in
  figures. To address this issue, we present SBSFigures (Stage-by-Stage Synthetic
  Figures), a dataset for pre-training figure QA. Our proposed pipeline enables
  the creation of chart figures with complete annotations of the visualized data
  and dense QA annotations without any manual annotation process. Our
  stage-by-stage pipeline makes it possible to create diverse topic and
  appearance figures efficiently while minimizing code errors. Our SBSFigures
  demonstrate a strong pre-training effect, making it possible to achieve
  efficient training with a limited amount of real-world chart data starting from
  our pre-trained weights.
paper_authors._id: 677204632f016f40c42e2180
paper_authors.name: Risa Shinoda
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-12-30T19:31:04.074Z
paper_authors._id: 651a7684a1a5e5d617e28f84
paper_authors.avatarUrl: /avatars/f484ae7c8d980818cd2ba3ffa682b781.svg
paper_authors.fullname: Risa Shinoda
paper_authors.type: user
paper_authors.user: risashinoda
paper_authors._id: 677204632f016f40c42e2181
paper_authors.name: Kuniaki Saito
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-12-30T20:23:08.219Z
paper_authors._id: 649937d773736b1e8e61a5fa
paper_authors.avatarUrl: /avatars/5da5e43a5bfc9c44194805dc8fa97e9a.svg
paper_authors.fullname: Kuniaki Saito
paper_authors.type: user
paper_authors.user: ksaito2omr
paper_authors._id: 677204632f016f40c42e2182
paper_authors.name: Shohei Tanaka
paper_authors._id: 677204632f016f40c42e2183
paper_authors.name: Tosho Hirasawa
paper_authors._id: 677204632f016f40c42e2184
paper_authors.name: Yoshitaka Ushiku
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-12-30T20:41:42.211Z
paper_authors._id: 6268cab5dc80d589a9f8ea82
paper_authors.avatarUrl: /avatars/2897993439d641478aa4e797551fccfb.svg
paper_authors.fullname: Yoshitaka Ushiku
paper_authors.type: user
paper_authors.user: yushiku
paper_title: SBS Figures: Pre-training Figure QA from Stage-by-Stage Synthesized
    Images
paper_summary: Building a large-scale figure QA dataset requires a considerable amount of
  work, from gathering and selecting figures to extracting attributes like text,
  numbers, and colors, and generating QAs. Although recent developments in LLMs
  have led to efforts to synthesize figures, most of these focus primarily on QA
  generation. Additionally, creating figures directly using LLMs often encounters
  issues such as code errors, similar-looking figures, and repetitive content in
  figures. To address this issue, we present SBSFigures (Stage-by-Stage Synthetic
  Figures), a dataset for pre-training figure QA. Our proposed pipeline enables
  the creation of chart figures with complete annotations of the visualized data
  and dense QA annotations without any manual annotation process. Our
  stage-by-stage pipeline makes it possible to create diverse topic and
  appearance figures efficiently while minimizing code errors. Our SBSFigures
  demonstrate a strong pre-training effect, making it possible to achieve
  efficient training with a limited amount of real-world chart data starting from
  our pre-trained weights.
paper_ai_summary: SBSFigures is a pre-training dataset for figure QA that generates synthetic chart figures with accurate annotations through a stage-by-stage pipeline, reducing manual effort and code errors.
paper_ai_keywords: LMMs figure QA synthetic figures dense QA annotations stage-by-stage pipeline pre-training chart data pre-trained weights