Besides, we compare AdaptLLM with other publicly-available models/results in each domain as
follows.
Biomedicine. We compare with MedAlpaca-7B/13B (Han et al., 2023), which fine-tunes LLaMA-
7B/13B (Touvron et al., 2023) on medical question-answering instructions. AdaptLLM-7B per-
forms better than MedAlpaca-7B and approaches MedAlpaca-13B in the average score. While the
supervised instructions help MedAlpaca-7B outperform General LLM-7B (LLaMA-7B) in some
domain-specific tasks, this advantage isn’t consistent. This could be because instructions don’t fully
infuse domain knowledge for all tasks, or the domain-specific instructions struggle with various
input-output scenarios.
Finance. We compare our results with those reported in BloombergGPT (Wu et al., 2023b), a
model trained from scratch on a mixture of financial and general corpora. While General LLM-7B
scores lower than BloombergGPT-50B, AdaptLLM-7B achieves competitive performance with the
ADAPTINGLARGELANGUAGEMODELSVIA READINGCOMPREHENSION