culties handling out-of-distribution data. Upon examining the generated answers from BiomedGPT, we
also observe its tendency to overfit intra-distribution instructions, leading to challenges in comprehend-
ing unseen questions and producing uncontrolled outputs. As an example, when presented with the 14th
question “Where is the pathology in this image?" from the VQA-RAD dataset, BiomedGPTBase
predicts < code_7948 >< code_5859 >< code_771 > ··· < code_7077 >< code_7077 >, indicating
BiomedGPT