This suggests that PMC-LLaMA oﬀers a better initialization for medical tasks.
Full ﬁne-tuning results. As shown in Tab. 1, PMC-LLaMA-7BFull exceeds the LLaMA-
7BFull in two of three test sets, improving the performance from 44.55% to 44.70% and
35.66% to 40.61% on USMLE for OOD and ID settings respectively, and 48.15% to 50.74%
on MedMCQA.
PMC-LLaMA- Further Finetuning LLaMA on Medical Papers