title: Alignment Studio: Aligning Large Language Models to Particular
    Contextual Regulations
summary: The alignment of large language models is usually done by model providers to
  add or control behaviors that are common or universally understood across use
  cases and contexts. In contrast, in this article, we present an approach and
  architecture that empowers application developers to tune a model to their
  particular values, social norms, laws and other regulations, and orchestrate
  between potentially conflicting requirements in context. We lay out three main
  components of such an Alignment Studio architecture: Framers, Instructors, and
  Auditors that work in concert to control the behavior of a language model. We
  illustrate this approach with a running example of aligning a company's
  internal-facing enterprise chatbot to its business conduct guidelines.
paper_authors._id: 65f7a455fdb0e12d2c46dc43
paper_authors.name: Swapnaja Achintalwar
paper_authors._id: 65f7a455fdb0e12d2c46dc44
paper_authors.name: Ioana Baldini
paper_authors._id: 65f7a455fdb0e12d2c46dc45
paper_authors.name: Djallel Bouneffouf
paper_authors._id: 65f7a455fdb0e12d2c46dc46
paper_authors.name: Joan Byamugisha
paper_authors._id: 65f7a455fdb0e12d2c46dc47
paper_authors.name: Maria Chang
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-18T09:03:07.845Z
paper_authors._id: 64f0f28739b002de8707edb4
paper_authors.avatarUrl: /avatars/9bfe37cbaa7671cad5dca92a581857b0.svg
paper_authors.fullname: Maria Chang
paper_authors.type: user
paper_authors.user: maria-chang
paper_authors._id: 65f7a455fdb0e12d2c46dc48
paper_authors.name: Pierre Dognin
paper_authors._id: 65f7a455fdb0e12d2c46dc49
paper_authors.name: Eitan Farchi
paper_authors._id: 65f7a455fdb0e12d2c46dc4a
paper_authors.name: Ndivhuwo Makondo
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-18T09:03:22.290Z
paper_authors._id: 6478fa2e50ff700163177a63
paper_authors.avatarUrl: /avatars/bdc86d5faea1d3088171cef52cbaf96c.svg
paper_authors.fullname: Ndivhuwo Makondo
paper_authors.type: user
paper_authors.user: Ndivhuwo
paper_authors._id: 65f7a455fdb0e12d2c46dc4b
paper_authors.name: Aleksandra Mojsilovic
paper_authors._id: 65f7a455fdb0e12d2c46dc4c
paper_authors.name: Manish Nagireddy
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-18T09:03:32.116Z
paper_authors._id: 659ed39fd75c46188d7496ff
paper_authors.avatarUrl: /avatars/665e4dd171f7e8c1c483cdeb02b71744.svg
paper_authors.fullname: Manish Nagireddy
paper_authors.type: user
paper_authors.user: mnagired
paper_authors._id: 65f7a455fdb0e12d2c46dc4d
paper_authors.name: Karthikeyan Natesan Ramamurthy
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-18T09:03:39.304Z
paper_authors._id: 65d77d5439352e8c0b45b06a
paper_authors.avatarUrl: /avatars/b2eae578ea01c37d590036b23f79c8bf.svg
paper_authors.fullname: Karthikeyan Natesan Ramamurthy
paper_authors.type: user
paper_authors.user: nrkarthikeyan
paper_authors._id: 65f7a455fdb0e12d2c46dc4e
paper_authors.name: Inkit Padhi
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-10-09T07:38:42.947Z
paper_authors._id: 656d56f30a5ec499aa0f57b1
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/656d56f30a5ec499aa0f57b1/YdXgxiwpJ0-xdn0UvOjj4.jpeg
paper_authors.fullname: Inkit
paper_authors.type: user
paper_authors.user: ink-pad
paper_authors._id: 65f7a455fdb0e12d2c46dc4f
paper_authors.name: Orna Raz
paper_authors._id: 65f7a455fdb0e12d2c46dc50
paper_authors.name: Jesus Rios
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-03-19T08:46:08.822Z
paper_authors._id: 644c226a778ecbfb977ff98f
paper_authors.avatarUrl: /avatars/1aabf342a6137a56986cac717aa3bc87.svg
paper_authors.fullname: Jesus Rios
paper_authors.type: user
paper_authors.user: jesusriosal
paper_authors._id: 65f7a455fdb0e12d2c46dc51
paper_authors.name: Prasanna Sattigeri
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-18T09:03:56.432Z
paper_authors._id: 63068ec0df993a789e69644b
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/63068ec0df993a789e69644b/hR4Qs1KFMpF7sW6VzXYH1.png
paper_authors.fullname: Prasanna Sattigeri
paper_authors.type: user
paper_authors.user: pronics2004
paper_authors._id: 65f7a455fdb0e12d2c46dc52
paper_authors.name: Moninder Singh
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-18T09:04:03.195Z
paper_authors._id: 6328dbe8b109150305e5683c
paper_authors.avatarUrl: /avatars/9b760fdd2104a7c9c558ee6f64730a87.svg
paper_authors.fullname: Moninder Singh
paper_authors.type: user
paper_authors.user: moninder
paper_authors._id: 65f7a455fdb0e12d2c46dc53
paper_authors.name: Siphiwe Thwala
paper_authors._id: 65f7a455fdb0e12d2c46dc54
paper_authors.name: Rosario A. Uceda-Sosa
paper_authors._id: 65f7a455fdb0e12d2c46dc55
paper_authors.name: Kush R. Varshney
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-18T09:04:18.499Z
paper_authors._id: 648b118c60292bdb12e402f6
paper_authors.avatarUrl: /avatars/8cc8a06447c871bae4405c837ba0661e.svg
paper_authors.fullname: Kush Varshney
paper_authors.type: user
paper_authors.user: kushvarshney
paper_title: Alignment Studio: Aligning Large Language Models to Particular
    Contextual Regulations
paper_summary: The alignment of large language models is usually done by model providers to
  add or control behaviors that are common or universally understood across use
  cases and contexts. In contrast, in this article, we present an approach and
  architecture that empowers application developers to tune a model to their
  particular values, social norms, laws and other regulations, and orchestrate
  between potentially conflicting requirements in context. We lay out three main
  components of such an Alignment Studio architecture: Framers, Instructors, and
  Auditors that work in concert to control the behavior of a language model. We
  illustrate this approach with a running example of aligning a company's
  internal-facing enterprise chatbot to its business conduct guidelines.
paper_ai_summary: An Alignment Studio architecture empowers developers to tailor language models to specific values, social norms, laws, and guidelines by integrating Framers, Instructors, and Auditors.
paper_ai_keywords: Alignment Studio Framers Instructors Auditors language models business conduct guidelines