#Images #Sample
217,060
217,060
7,470
7,470
7.442
7.442
642
4,998
32,120
755

32,799
32,735
13,673

7,033 (EN)

224,315
890K
33,126
5,126

-
-
-

-
-
-
-

181 M
52,976
1.8 M

2.3 Natural Language as a Task Manager

Multitasking is a key attribute of a unified and generalist model. Following previous literature on language
models using prompt / instruction learning (Brown et al., 2020; Liu et al., 2023; Wei et al., 2022; Gao
et al., 2021; Schick & Schütze, 2021), and the existing unified frameworks to eliminate task-specific modules,
we specify each task with a handcrafted instruction excluding some tasks like Visual Question Answering
(VQA), which are fully specified by their text inputs. BiomedGPT supports abstractions of several tasks,
including vision-only, text-only, and vision-language, to achieve task comprehensiveness. We provide details
of the pretraining tasks, fine-tuning / inference tasks, as well as their corresponding instructions in the
following.
BiomedGPT