Training Socially Aligned Language Models in Simulated Human Society
Social alignment in AI systems aims to ensure that these models behave
according to established societal values. However, unlike humans, who derive
consensus on value judgments through social interaction, current language
models (LMs) are trained to rigidly replicate their training corpus in
isolation, leading to subpar generalization in unfamiliar scenarios and
vulnerability to adversarial attacks. This work presents a novel training
paradigm that permits LMs to learn from simulated social interactions. In
comparison to existing methodologies, our approach is considerably more
scalable and efficient, demonstrating superior performance in alignment
benchmarks and human evaluations. This paradigm shift in the training of LMs
brings us a step closer to developing AI systems that can robustly and
accurately reflect societal norms and values.
6473f9752a74fb43cce7bc6a
Ruibo Liu
claimed_verified
2023-05-29T13:17:22.512Z
5e91f1554957053f606489ff
https://cdn-avatars.huggingface.co/v1/production/uploads/5e91f1554957053f606489ff/eJty7TksRLwuta0deZTmt.jpeg
Ruibo Liu
user
agi-css
6473f9752a74fb43cce7bc6b
Ruixin Yang
claimed_verified
2024-10-22T08:03:57.929Z
629d3e2ce6709241d69cf2b6
/avatars/4d213e0c6649a0db63c51eb84fad413a.svg
Ray Yang
user
RayY
6473f9752a74fb43cce7bc6c
Chenyan Jia
6473f9752a74fb43cce7bc6d
Ge Zhang
claimed_verified
2024-02-08T09:50:46.404Z
638efcf4c67af472d316d424
/avatars/97a57859d7d87a3a8f1bb41d32a72bc2.svg
Ge Zhang
user
zhangysk
6473f9752a74fb43cce7bc6e
Denny Zhou
claimed_verified
2024-02-20T18:28:38.521Z
65d4d62d493aeaf0bb295f1b
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/vXMxaoWwFziul8TqIhQw8.jpeg
Denny Zhou
user
dennyzhou
6473f9752a74fb43cce7bc6f
Andrew M. Dai
6473f9752a74fb43cce7bc70
Diyi Yang
6473f9752a74fb43cce7bc71
Soroush Vosoughi
claimed_verified
2023-06-08T16:08:41.881Z
648169d3cb64a2b85a4606e6
https://cdn-avatars.huggingface.co/v1/production/uploads/648169d3cb64a2b85a4606e6/6nEeE3TWvO9O5dCJTOG0C.jpeg
Soroush Vosoughi
user
soroushv
Training Socially Aligned Language Models in Simulated Human Society
Social alignment in AI systems aims to ensure that these models behave
according to established societal values. However, unlike humans, who derive
consensus on value judgments through social interaction, current language
models (LMs) are trained to rigidly replicate their training corpus in
isolation, leading to subpar generalization in unfamiliar scenarios and
vulnerability to adversarial attacks. This work presents a novel training
paradigm that permits LMs to learn from simulated social interactions. In
comparison to existing methodologies, our approach is considerably more
scalable and efficient, demonstrating superior performance in alignment
benchmarks and human evaluations. This paradigm shift in the training of LMs
brings us a step closer to developing AI systems that can robustly and
accurately reflect societal norms and values.
A novel training paradigm enables language models to learn from simulated social interactions, improving their alignment with societal norms and values compared to existing methods.
social alignment AI systems language models training corpus adversarial attacks simulated social interactions alignment benchmarks