ProgressGym: Alignment with a Millennium of Moral Progress
Frontier AI systems, including large language models (LLMs), hold increasing
influence over the epistemology of human users. Such influence can reinforce
prevailing societal values, potentially contributing to the lock-in of
misguided moral beliefs and, consequently, the perpetuation of problematic
moral practices on a broad scale. We introduce progress alignment as a
technical solution to mitigate this imminent risk. Progress alignment
algorithms learn to emulate the mechanics of human moral progress, thereby
addressing the susceptibility of existing alignment methods to contemporary
moral blindspots. To empower research in progress alignment, we introduce
ProgressGym, an experimental framework allowing the learning of moral progress
mechanics from history, in order to facilitate future progress in real-world
moral decisions. Leveraging 9 centuries of historical text and 18 historical
LLMs, ProgressGym enables codification of real-world progress alignment
challenges into concrete benchmarks. Specifically, we introduce three core
challenges: tracking evolving values (PG-Follow), preemptively anticipating
moral progress (PG-Predict), and regulating the feedback loop between human and
AI value shifts (PG-Coevolve). Alignment methods without a temporal dimension
are inapplicable to these tasks. In response, we present lifelong and
extrapolative algorithms as baseline methods of progress alignment, and build
an open leaderboard soliciting novel algorithms and challenges. The framework
and the leaderboard are available at
https://github.com/PKU-Alignment/ProgressGym and
https://huggingface.co/spaces/PKU-Alignment/ProgressGym-LeaderBoard
respectively.
66824a26ab37b944284dda8b
Tianyi Qiu
claimed_verified
2024-07-01T07:46:27.168Z
653260d5303c8ba75ae698e1
https://cdn-avatars.huggingface.co/v1/production/uploads/653260d5303c8ba75ae698e1/AH35uVCNuyzSZVlOFRcw2.png
Tianyi Qiu
user
TianyiQ
66824a26ab37b944284dda8c
Yang Zhang
66824a26ab37b944284dda8d
Xuchuan Huang
claimed_verified
2025-07-03T07:43:56.875Z
66ee5cf1801ea45d7a44a542
/avatars/04bafbcbf1aea3920a79bddbd1a18f42.svg
XUCHUAN HUANG
user
Feernnn
66824a26ab37b944284dda8e
Jasmine Xinze Li
66824a26ab37b944284dda8f
Jiaming Ji
admin_assigned
2024-07-03T09:01:54.778Z
6429b13816d4d8293c97a949
https://cdn-avatars.huggingface.co/v1/production/uploads/6429b13816d4d8293c97a949/LNuQ1gvW2NMmWyIuEpzCA.jpeg
JiJiaming
user
jijiaming
66824a26ab37b944284dda90
Yaodong Yang
ProgressGym: Alignment with a Millennium of Moral Progress
Frontier AI systems, including large language models (LLMs), hold increasing
influence over the epistemology of human users. Such influence can reinforce
prevailing societal values, potentially contributing to the lock-in of
misguided moral beliefs and, consequently, the perpetuation of problematic
moral practices on a broad scale. We introduce progress alignment as a
technical solution to mitigate this imminent risk. Progress alignment
algorithms learn to emulate the mechanics of human moral progress, thereby
addressing the susceptibility of existing alignment methods to contemporary
moral blindspots. To empower research in progress alignment, we introduce
ProgressGym, an experimental framework allowing the learning of moral progress
mechanics from history, in order to facilitate future progress in real-world
moral decisions. Leveraging 9 centuries of historical text and 18 historical
LLMs, ProgressGym enables codification of real-world progress alignment
challenges into concrete benchmarks. Specifically, we introduce three core
challenges: tracking evolving values (PG-Follow), preemptively anticipating
moral progress (PG-Predict), and regulating the feedback loop between human and
AI value shifts (PG-Coevolve). Alignment methods without a temporal dimension
are inapplicable to these tasks. In response, we present lifelong and
extrapolative algorithms as baseline methods of progress alignment, and build
an open leaderboard soliciting novel algorithms and challenges. The framework
and the leaderboard are available at
https://github.com/PKU-Alignment/ProgressGym and
https://huggingface.co/spaces/PKU-Alignment/ProgressGym-LeaderBoard
respectively.
Progress alignment algorithms and ProgressGym framework address the challenge of reinforcing and perpetuating societal values through AI systems by learning moral progress mechanics from historical data.
large language models progress alignment moral progress ProgressGym lifelong algorithms extrapolative algorithms