SummarizeWord-to-TextN.L.ICommon.Reason.ParaphraseTextComple.Close.QARead.Compre.14354555657585BioMed.FinanceLawFine-tune ScoreDomain KnowledgePrompting AbilitySummarizationWord-to-TextLanguageInferenceCommonsenseReasoningParaphraseDetectionTextCompletionNaturalQuestionReadingComprehensionGeneral LLMRaw TextRead. Compre.14.119.237.672.839.512.029.632.311919151238312424324012107182430332720445873Training from Scratch. Training a domain-specific language models from scratch is an intuitive
approach to realize domain specialization. BloombergGPT (Wu et al., 2023b) represents an early
example of large language models in the financial domain, trained on a mix of financial and general
corpora. This approach demonstrates significant improvements in performance on financial tasks
without sacrificing the performance on general LLM benchmarks. However, studies (Yang et al.,
2023; Ling et al., 2023) have pointed out “training from scratch” comes with expensive computa-
ADAPTINGLARGELANGUAGEMODELSVIA READINGCOMPREHENSION