title: SaulLM-7B: A pioneering Large Language Model for Law
summary: In this paper, we introduce SaulLM-7B, a large language model (LLM) tailored
  for the legal domain. With 7 billion parameters, SaulLM-7B is the first LLM
  designed explicitly for legal text comprehension and generation. Leveraging the
  Mistral 7B architecture as its foundation, SaulLM-7B is trained on an English
  legal corpus of over 30 billion tokens. SaulLM-7B exhibits state-of-the-art
  proficiency in understanding and processing legal documents. Additionally, we
  present a novel instructional fine-tuning method that leverages legal datasets
  to further enhance SaulLM-7B's performance in legal tasks. SaulLM-7B is
  released under the CC-BY-SA-4.0 License.
paper_authors._id: 65e953938106a03c253fb6fb
paper_authors.name: Pierre Colombo
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-07T09:45:43.650Z
paper_authors._id: 644a900e3a619fe72b14af0f
paper_authors.avatarUrl: /avatars/e2d5dac3d92757ed48e37e126a3464a3.svg
paper_authors.fullname: Colombo
paper_authors.type: user
paper_authors.user: PierreColombo
paper_authors._id: 65e953938106a03c253fb6fc
paper_authors.name: Telmo Pessoa Pires
paper_authors._id: 65e953938106a03c253fb6fd
paper_authors.name: Malik Boudiaf
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-07T09:46:10.972Z
paper_authors._id: 639283dd2c0c90e2f31b5500
paper_authors.avatarUrl: /avatars/9a3cff6b14fd687bcbe2b78c4c032619.svg
paper_authors.fullname: Malik Boudiaf
paper_authors.type: user
paper_authors.user: mboudiaf
paper_authors._id: 65e953938106a03c253fb6fe
paper_authors.name: Dominic Culver
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-07T09:46:17.807Z
paper_authors._id: 6453da2ef2122886b298873f
paper_authors.avatarUrl: /avatars/8c79e43e5d76cd8d29db9357180b629d.svg
paper_authors.fullname: Dominic Culver
paper_authors.type: user
paper_authors.user: CWcx
paper_authors._id: 65e953938106a03c253fb6ff
paper_authors.name: Rui Melo
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-07T09:46:32.228Z
paper_authors._id: 622f26eb163b4ef6fd7a5361
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/622f26eb163b4ef6fd7a5361/-WYJwPC5QkWecz_XL8w94.jpeg
paper_authors.fullname: Rui Melo
paper_authors.type: user
paper_authors.user: rufimelo
paper_authors._id: 65e953938106a03c253fb700
paper_authors.name: Caio Corro
paper_authors._id: 65e953938106a03c253fb701
paper_authors.name: Andre F. T. Martins
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-07T09:47:28.649Z
paper_authors._id: 6326de72a28c096b45a8f8da
paper_authors.avatarUrl: /avatars/94c89f31ab5eee80c95b5bbf6688c05f.svg
paper_authors.fullname: Andre Martins
paper_authors.type: user
paper_authors.user: andre-martins
paper_authors._id: 65e953938106a03c253fb702
paper_authors.name: Fabrizio Esposito
paper_authors._id: 65e953938106a03c253fb703
paper_authors.name: Vera Lúcia Raposo
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-07T09:47:45.616Z
paper_authors._id: 64f7a9604928280883583989
paper_authors.avatarUrl: /avatars/84d8acade4f71a9ee2dab5f42025d9c6.svg
paper_authors.fullname: Vera Lúcia Raposo
paper_authors.type: user
paper_authors.user: vl76
paper_authors._id: 65e953938106a03c253fb704
paper_authors.name: Sofia Morgado
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-07T09:47:51.378Z
paper_authors._id: 63e76a3ce02ee67e8e4fcdc2
paper_authors.avatarUrl: /avatars/ca8668fb2fdafb264291a7585c0ddd6b.svg
paper_authors.fullname: Sofia Morgado
paper_authors.type: user
paper_authors.user: somorgado
paper_authors._id: 65e953938106a03c253fb705
paper_authors.name: Michael Desa
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-07T09:48:05.022Z
paper_authors._id: 62cee925e7f6014c0e9d7b93
paper_authors.avatarUrl: /avatars/39e82af1550d57d06963ad87d42514e5.svg
paper_authors.fullname: Michael Desa
paper_authors.type: user
paper_authors.user: desa
paper_title: SaulLM-7B: A pioneering Large Language Model for Law
paper_summary: In this paper, we introduce SaulLM-7B, a large language model (LLM) tailored
  for the legal domain. With 7 billion parameters, SaulLM-7B is the first LLM
  designed explicitly for legal text comprehension and generation. Leveraging the
  Mistral 7B architecture as its foundation, SaulLM-7B is trained on an English
  legal corpus of over 30 billion tokens. SaulLM-7B exhibits state-of-the-art
  proficiency in understanding and processing legal documents. Additionally, we
  present a novel instructional fine-tuning method that leverages legal datasets
  to further enhance SaulLM-7B's performance in legal tasks. SaulLM-7B is
  released under the CC-BY-SA-4.0 License.
paper_ai_keywords: large language model (LLM) Mistral 7B architecture legal domain legal text comprehension legal text generation instructional fine-tuning method neural network CC-BY-SA-4.0 License