SBS Figures: Pre-training Figure QA from Stage-by-Stage Synthesized
  Images
Building a large-scale figure QA dataset requires a considerable amount of
work, from gathering and selecting figures to extracting attributes like text,
numbers, and colors, and generating QAs. Although recent developments in LLMs
have led to efforts to synthesize figures, most of these focus primarily on QA
generation. Additionally, creating figures directly using LLMs often encounters
issues such as code errors, similar-looking figures, and repetitive content in
figures. To address this issue, we present SBSFigures (Stage-by-Stage Synthetic
Figures), a dataset for pre-training figure QA. Our proposed pipeline enables
the creation of chart figures with complete annotations of the visualized data
and dense QA annotations without any manual annotation process. Our
stage-by-stage pipeline makes it possible to create diverse topic and
appearance figures efficiently while minimizing code errors. Our SBSFigures
demonstrate a strong pre-training effect, making it possible to achieve
efficient training with a limited amount of real-world chart data starting from
our pre-trained weights.
677204632f016f40c42e2180
Risa Shinoda
claimed_verified
2024-12-30T19:31:04.074Z
651a7684a1a5e5d617e28f84
/avatars/f484ae7c8d980818cd2ba3ffa682b781.svg
Risa Shinoda
user
risashinoda
677204632f016f40c42e2181
Kuniaki Saito
admin_assigned
2024-12-30T20:23:08.219Z
649937d773736b1e8e61a5fa
/avatars/5da5e43a5bfc9c44194805dc8fa97e9a.svg
Kuniaki Saito
user
ksaito2omr
677204632f016f40c42e2182
Shohei Tanaka
677204632f016f40c42e2183
Tosho Hirasawa
677204632f016f40c42e2184
Yoshitaka Ushiku
admin_assigned
2024-12-30T20:41:42.211Z
6268cab5dc80d589a9f8ea82
/avatars/2897993439d641478aa4e797551fccfb.svg
Yoshitaka Ushiku
user
yushiku
SBS Figures: Pre-training Figure QA from Stage-by-Stage Synthesized
  Images
Building a large-scale figure QA dataset requires a considerable amount of
work, from gathering and selecting figures to extracting attributes like text,
numbers, and colors, and generating QAs. Although recent developments in LLMs
have led to efforts to synthesize figures, most of these focus primarily on QA
generation. Additionally, creating figures directly using LLMs often encounters
issues such as code errors, similar-looking figures, and repetitive content in
figures. To address this issue, we present SBSFigures (Stage-by-Stage Synthetic
Figures), a dataset for pre-training figure QA. Our proposed pipeline enables
the creation of chart figures with complete annotations of the visualized data
and dense QA annotations without any manual annotation process. Our
stage-by-stage pipeline makes it possible to create diverse topic and
appearance figures efficiently while minimizing code errors. Our SBSFigures
demonstrate a strong pre-training effect, making it possible to achieve
efficient training with a limited amount of real-world chart data starting from
our pre-trained weights.
SBSFigures is a pre-training dataset for figure QA that generates synthetic chart figures with accurate annotations through a stage-by-stage pipeline, reducing manual effort and code errors.
LMMs figure QA synthetic figures dense QA annotations stage-by-stage pipeline pre-training chart data pre-trained weights