263 See Yoshua Bengio’s FAQ on catastrophic AI risks and his testimony to the US Senate, July 2023. 
264 CONTEST: The United Kingdom's Strategy for Countering Terrorism, Home Office, 2023.  
265 Richard Sutton’s talk entitled AI Succession, 2023; 
Accelerationism: how a fringe philosophy predicted the future we live in, Beckett, 2017; 
Effective accelerationism.  
266 If some safeguards limit AI capabilities, then these bad actors might be able to deploy more capable AI 
systems than responsible actors. They might be willing to remove safeguards which increase human control but 
also limit AI capabilities.  
267 This includes both the difficulty of developing an AI system with the intended goal and difficulty of evaluating 
whether an AI system has an intended goal. See discussion in the earlier section of the report on cross cutting 
technical risk factors. See also: 
Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback, Casper, 2023;
Capabilities and risks from frontier AI 