SaulLM-7B: A pioneering Large Language Model for Law
<|reference_start|>SaulLM-7B: A pioneering Large Language Model for Law: In this paper, we introduce SaulLM-7B, a large language model (LLM) tailored for the legal domain. With 7 billion parameters, SaulLM-7B is the first LLM designed explicitly for legal text comprehension and generation. Leveraging the Mistral 7B architecture as its foundation, SaulLM-7B is trained on an English legal corpus of over 30 billion tokens. SaulLM-7B exhibits state-of-the-art proficiency in understanding and processing legal documents. Additionally, we present a novel instructional fine-tuning method that leverages legal datasets to further enhance SaulLM-7B's performance in legal tasks. SaulLM-7B is released under the MIT License.<|reference_end|>
@article{colombo2024saullm-7b:,
    title={SaulLM-7B: A pioneering Large Language Model for Law},
    author={Pierre Colombo, Telmo Pessoa Pires, Malik Boudiaf, Dominic Culver, Rui
  Melo, Caio Corro, Andre F. T. Martins, Fabrizio Esposito, Vera L'ucia
  Raposo, Sofia Morgado, Michael Desa},
    journal={arXiv preprint arXiv:2403.03883},
    year={2024},
    archivePrefix={arXiv},
    eprint={2403.03883},
    primaryClass={cs.CL}
}