title: PERSONA: A Reproducible Testbed for Pluralistic Alignment
summary: The rapid advancement of language models (LMs) necessitates robust alignment
  with diverse user values. However, current preference optimization approaches
  often fail to capture the plurality of user opinions, instead reinforcing
  majority viewpoints and marginalizing minority perspectives. We introduce
  PERSONA, a reproducible test bed designed to evaluate and improve pluralistic
  alignment of LMs. We procedurally generate diverse user profiles from US census
  data, resulting in 1,586 synthetic personas with varied demographic and
  idiosyncratic attributes. We then generate a large-scale evaluation dataset
  containing 3,868 prompts and 317,200 feedback pairs obtained from our synthetic
  personas. Leveraging this dataset, we systematically evaluate LM capabilities
  in role-playing diverse users, verified through human judges, and the
  establishment of both a benchmark, PERSONA Bench, for pluralistic alignment
  approaches as well as an extensive dataset to create new and future benchmarks.
  The full dataset and benchmarks are available here:
  https://www.synthlabs.ai/research/persona.
paper_authors._id: 66a1c18c345b3106f46a7fb4
paper_authors.name: Louis Castricato
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-25T12:21:47.740Z
paper_authors._id: 60d35a0307da9c17c7270909
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/1665155571839-60d35a0307da9c17c7270909.jpeg
paper_authors.fullname: Louis Castricato
paper_authors.type: user
paper_authors.user: LouisCastricato
paper_authors._id: 66a1c18c345b3106f46a7fb5
paper_authors.name: Nathan Lile
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-25T12:21:54.067Z
paper_authors._id: 61aa15fd8a9625ebfe284286
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/61aa15fd8a9625ebfe284286/KaGzIeijcgcN15JErCqft.jpeg
paper_authors.fullname: nathan lile
paper_authors.type: user
paper_authors.user: nlile
paper_authors._id: 66a1c18c345b3106f46a7fb6
paper_authors.name: Rafael Rafailov
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-25T12:22:00.797Z
paper_authors._id: 64701c98d742e9ef6522598f
paper_authors.avatarUrl: /avatars/df3a52bd4bc374d7cb4061f449f75c07.svg
paper_authors.fullname: Rafael Rafailov
paper_authors.type: user
paper_authors.user: rmrafailov
paper_authors._id: 66a1c18c345b3106f46a7fb7
paper_authors.name: Jan-Philipp Fränken
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-25T12:22:05.992Z
paper_authors._id: 63f3b441a096536aeab002b1
paper_authors.avatarUrl: /avatars/e5e63b589d791a78e5f1b09b106287bf.svg
paper_authors.fullname: Jan-Philipp Fränken
paper_authors.type: user
paper_authors.user: janphilippfranken
paper_authors._id: 66a1c18c345b3106f46a7fb8
paper_authors.name: Chelsea Finn
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-25T12:22:11.482Z
paper_authors._id: 64ac22a9193f0a807deb673d
paper_authors.avatarUrl: /avatars/fcac4912678ad3cb6e817d40bdee9aea.svg
paper_authors.fullname: Chelsea Finn
paper_authors.type: user
paper_authors.user: cbfinn
paper_title: PERSONA: A Reproducible Testbed for Pluralistic Alignment
paper_summary: The rapid advancement of language models (LMs) necessitates robust alignment
  with diverse user values. However, current preference optimization approaches
  often fail to capture the plurality of user opinions, instead reinforcing
  majority viewpoints and marginalizing minority perspectives. We introduce
  PERSONA, a reproducible test bed designed to evaluate and improve pluralistic
  alignment of LMs. We procedurally generate diverse user profiles from US census
  data, resulting in 1,586 synthetic personas with varied demographic and
  idiosyncratic attributes. We then generate a large-scale evaluation dataset
  containing 3,868 prompts and 317,200 feedback pairs obtained from our synthetic
  personas. Leveraging this dataset, we systematically evaluate LM capabilities
  in role-playing diverse users, verified through human judges, and the
  establishment of both a benchmark, PERSONA Bench, for pluralistic alignment
  approaches as well as an extensive dataset to create new and future benchmarks.
  The full dataset and benchmarks are available here:
  https://www.synthlabs.ai/research/persona.