PathVQA (He et al., 2020) is a pathology VQA dataset consisting of 4,998 images and 32,799 question-
answer pairs. There are 7 categories of questions: what, where, when, whose, how, how much/how many,
and yes/no. The questions in the first 6 categories are open-ended while the rest are close-ended.

DeepLesion (Yan et al., 2018) is a dataset with 32,735 lesions in 32,120 CT slices from 10,594 studies of
4,427 unique patients. There are a variety of lesion types in this dataset, such as lung nodules, liver tumors,
enlarged lymph nodes, etc.

PubMed Abstracts are provided by BLUE benchmark (Peng et al., 2019) containing 181 million sentences.
We do not use PMC full articles because the prior works (Gu et al., 2021), training on both corpora of
abstracts and articles surprisingly leads to a slight degradation in performance compared to sole training on
PubMed abstracts.
BiomedGPT