The Alignment Problem from a Deep Learning Perspective, Ngo et al., 2022. 

268 Goal misgeneralization: Why correct specifications aren’t enough for correct goals, Shah et al., 2022. 
Goal Misgeneralization in Deep Reinforcement Learning, Langosco et al, 2021. 
The Effects of Reward Misspecification: Mapping and Mitigating Misaligned Models, Pan et al, 2022. 
Specification gaming: the flip side of AI ingenuity, Krakovna et al., 2020 
Learning from human preferences, Amodei et al., 2017 
269 Chapter 7, Superintelligence: Paths, Dangers, Strategies, Nick Bostrom, 2014. 

270 The Alignment Problem from a Deep Learning Perspective, Ngo, 2022; 

Is Power-Seeking AI an Existential Risk?, Carlsmith, 2022. 

44Frontier AI – Capabilities and Risks 

271 AI Causes Real Harm. Let's Focus on That over the End-of-Humanity Hype, Bender, 2023.
Capabilities and risks from frontier AI 