Some people who advocate worrying about AI risks have mentioned the &quot;AI Box Experiment&quot; in this regard:<p><a href="http:&#x2F;&#x2F;rationalwiki.org&#x2F;wiki&#x2F;AI-box_experiment" rel="nofollow">http:&#x2F;&#x2F;rationalwiki.org&#x2F;wiki&#x2F;AI-box_experiment</a><p><a href="https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;AI_box" rel="nofollow">https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;AI_box</a><p>As a summary, people roleplayed this situation and the &quot;AI&quot; managed to &quot;escape&quot; the controls by somehow inducing a supervisor to disable them. (The supervisor&#x27;s preassigned responsibility in the roleplay was to refuse to disable the controls.) We don&#x27;t know how this was accomplished, but it happened more than once.<p>I&#x27;m not sure that this is <i>always</i> an important risk for every kind of superintelligence in every circumstance, but it seems like it sure could be for one that knows a tremendous amount about the world and sees important reasons to try to act autonomously.