title: Histoires Morales: A French Dataset for Assessing Moral Alignment
summary: Aligning language models with human values is crucial, especially as they
  become more integrated into everyday life. While models are often adapted to
  user preferences, it is equally important to ensure they align with moral norms
  and behaviours in real-world social situations. Despite significant progress in
  languages like English and Chinese, French has seen little attention in this
  area, leaving a gap in understanding how LLMs handle moral reasoning in this
  language. To address this gap, we introduce Histoires Morales, a French dataset
  derived from Moral Stories, created through translation and subsequently
  refined with the assistance of native speakers to guarantee grammatical
  accuracy and adaptation to the French cultural context. We also rely on
  annotations of the moral values within the dataset to ensure their alignment
  with French norms. Histoires Morales covers a wide range of social situations,
  including differences in tipping practices, expressions of honesty in
  relationships, and responsibilities toward animals. To foster future research,
  we also conduct preliminary experiments on the alignment of multilingual models
  on French and English data and the robustness of the alignment. We find that
  while LLMs are generally aligned with human moral norms by default, they can be
  easily influenced with user-preference optimization for both moral and immoral
  data.
paper_authors._id: 6799e5f9121155210e4fa48c
paper_authors.name: Thibaud Leteno
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-01-29T17:29:00.764Z
paper_authors._id: 6239d3fa32af073244f7740d
paper_authors.avatarUrl: /avatars/36d4c6f7a650a5606613efaf9f0bc71e.svg
paper_authors.fullname: Thibaud Leteno
paper_authors.type: user
paper_authors.user: thibaudltn
paper_authors._id: 6799e5f9121155210e4fa48d
paper_authors.name: Irina Proskurina
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-01-29T17:16:01.526Z
paper_authors._id: 629a3dbcd496c6dcdebf41cc
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/1655113762275-629a3dbcd496c6dcdebf41cc.jpeg
paper_authors.fullname: Irina Proskurina
paper_authors.type: user
paper_authors.user: iproskurina
paper_authors._id: 6799e5f9121155210e4fa48e
paper_authors.name: Antoine Gourru
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-01-29T17:29:06.818Z
paper_authors._id: 64e475d0ba1c93ea6d23cf78
paper_authors.avatarUrl: /avatars/217833f8932d494465e4e383ee03c384.svg
paper_authors.fullname: Antoine Gourru
paper_authors.type: user
paper_authors.user: AntoineGourru
paper_authors._id: 6799e5f9121155210e4fa48f
paper_authors.name: Julien Velcin
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-01-29T17:29:13.336Z
paper_authors._id: 638f42767879bae278a73482
paper_authors.avatarUrl: /avatars/2fadaf4e4457aab35a18a129fffaf3eb.svg
paper_authors.fullname: Julien Velcin
paper_authors.type: user
paper_authors.user: jvelcin
paper_authors._id: 6799e5f9121155210e4fa490
paper_authors.name: Charlotte Laclau
paper_authors._id: 6799e5f9121155210e4fa491
paper_authors.name: Guillaume Metzler
paper_authors._id: 6799e5f9121155210e4fa492
paper_authors.name: Christophe Gravier
paper_title: Histoires Morales: A French Dataset for Assessing Moral Alignment
paper_summary: Aligning language models with human values is crucial, especially as they
  become more integrated into everyday life. While models are often adapted to
  user preferences, it is equally important to ensure they align with moral norms
  and behaviours in real-world social situations. Despite significant progress in
  languages like English and Chinese, French has seen little attention in this
  area, leaving a gap in understanding how LLMs handle moral reasoning in this
  language. To address this gap, we introduce Histoires Morales, a French dataset
  derived from Moral Stories, created through translation and subsequently
  refined with the assistance of native speakers to guarantee grammatical
  accuracy and adaptation to the French cultural context. We also rely on
  annotations of the moral values within the dataset to ensure their alignment
  with French norms. Histoires Morales covers a wide range of social situations,
  including differences in tipping practices, expressions of honesty in
  relationships, and responsibilities toward animals. To foster future research,
  we also conduct preliminary experiments on the alignment of multilingual models
  on French and English data and the robustness of the alignment. We find that
  while LLMs are generally aligned with human moral norms by default, they can be
  easily influenced with user-preference optimization for both moral and immoral
  data.
paper_ai_summary: Histoires Morales, a French moral reasoning dataset, addresses gaps in understanding how language models align with human values in French by providing culturally adapted data and annotations.
paper_ai_keywords: Moral Stories multilingual models moral reasoning cultural context user-preference optimization