Answers.Body: <p>Metaphorically: make it so depressed it commits suicide.</p>
  
  <p>As per my answer to <a href="https://ai.stackexchange.com/questions/1768/could-a-paradox-kill-an-ai">this AI SE question</a>, the idea is to feed it a sequence of inputs that will cause it to become (permanently) inactive.</p>
  
  <p>The technical details of how this might be achieved (and they <em>are</em> somewhat technical) can be found in <a href="https://arxiv.org/pdf/1606.00652.pdf" rel="nofollow noreferrer">this paper</a>.</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-12-05T18:10:04.773Z
Answers.Text: Out of interest, is there any evidence to suggest such a tactic might work?
Answers.UserDisplayName: GJZ
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-12-05T18:25:56.330Z
Answers.Text: Even better - there is a proof. For the right choice of inputs, this is what is formally described in the original article.
Answers.UserDisplayName: NietzscheanAI
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-11-07T19:30:01.783Z
Answers.LastActivityDate: 2016-11-07T19:30:01.783Z
Answers.LastEditDate: 2017-04-13T12:53:10.013Z
Answers.UserDisplayName: NietzscheanAI
Answers.Body: <p>If an AI is developed by humans, we surely can create another one!</p>
  
  <p>Develop another AI agent without all the possible bugs that can make it go rogue to tackle the rogue AI, but more technically advanced than the previous one. Hardwire it with the sole purpose of disabling any rogue AI agent that can harm humanity and have it <strong>self-destruct</strong> in case it is corrupted.</p>
  
  <p>If the AI is really strong, it can anticipate every move of human resistance, but it cannot fathom the mind of another AI agent.</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-12-05T18:11:10.417Z
Answers.Text: **"Hardwire it with the sole purpose of disabling any rogue AI agent that can harm humanity and have it self-destruct in case it is corrupted."** Sounds good in principle, but wouldn't you do something similar for the first one?
Answers.UserDisplayName: GJZ
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-12-05T19:14:13.847Z
Answers.Text: Nope. We would have hardwired it with the sole purpose of whatever it was designed to do, like drive a car or something. We could, though, create one such AI in advance just for emergency.
Answers.UserDisplayName: skrtbhtngr
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-11-11T23:17:52.990Z
Answers.LastActivityDate: 2016-11-11T23:17:52.990Z
Answers.UserDisplayName: skrtbhtngr
Answers.Body: <h3>Nuke it from orbit - it's the only way to be sure</h3>
  <p>If you want to be really sure you destroy everything of the AI, you'll need to launch an EMP (electromagnetic pulse) from the orbit (there are different ways to achieve this, one would be an atomic bomb, but there are better ones). EMPs will destroy every electronic device it hits without causing really much damage to humans.</p>
  <p>Also an interesting read on a similar topic: <a href="https://what-if.xkcd.com/5/" rel="nofollow noreferrer">https://what-if.xkcd.com/5/</a>
  Especially this is gonna be interesting:</p>
  <blockquote>
  <p>[...] nuclear explosions generate powerful electromagnetic pulses. These EMPs overload and destroy delicate electronic circuits. [...]
  And nuclear weapons could actually give us an edge. If we managed to
  set any of them off in the upper atmosphere, the EMP effect would be
  much more powerful.</p>
  </blockquote>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2016-11-09T11:12:09.100Z
Answers.LastActivityDate: 2020-08-18T12:59:51.640Z
Answers.LastEditDate: 2020-08-18T12:59:51.640Z
Answers.UserDisplayName: Namnodorel
Body: <p>Suppose that an artificial superintelligence (ASI) has finally been developed, but it has rebelled against humanity. We can assume that the ASI is online and can reproduce itself through electronic devices.</p>
  <p>How would you disable the AI in the most efficient way possible reducing damage as much as possible?</p>
  
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2016-11-08T10:37:41.867Z
Comments.Text: This seems to me like a virus situation. I'm not sure how modern DDOS attacks are resolved but similar strategy could be applied to this scenario.
Comments.UserDisplayName: tmaj
Tags: <agi><superintelligence><control-problem><ai-takeover><self-replicating-machines>
Title: What would be the best way to disable a rogue AI?
UserDisplayName: MountainSide Studios
ThreadText: # What would be the best way to disable a rogue AI?
  
  (Asked by: username_0 on 2016-11-05)
  
  Suppose that an artificial superintelligence (ASI) has finally been developed, but it has rebelled against humanity. We can assume that the ASI is online and can reproduce itself through electronic devices.
  
  How would you disable the AI in the most efficient way possible reducing damage as much as possible?
  
  **Tags:** agi, superintelligence, control-problem, ai-takeover, self-replicating-machines
  
  > **Comments:**
  > **username_1**: This seems to me like a virus situation. I'm not sure how modern DDOS attacks are resolved but similar strategy could be applied to this scenario.  
  
  ---
  
  ## 3 answers
  
  ### Answer by username_5 on 2016-11-09. Score: 3 | Accepted answer
  
  ### Nuke it from orbit - it's the only way to be sure
  
  If you want to be really sure you destroy everything of the AI, you'll need to launch an EMP (electromagnetic pulse) from the orbit (there are different ways to achieve this, one would be an atomic bomb, but there are better ones). EMPs will destroy every electronic device it hits without causing really much damage to humans.
  
  Also an interesting read on a similar topic: <https://what-if.xkcd.com/5/>
  Especially this is gonna be interesting:
  
  > [...] nuclear explosions generate powerful electromagnetic pulses. These EMPs overload and destroy delicate electronic circuits. [...]
  > And nuclear weapons could actually give us an edge. If we managed to
  > set any of them off in the upper atmosphere, the EMP effect would be
  > much more powerful.
  
  
  ---
  
  ### Answer by username_2 on 2016-11-07. Score: 4
  
  Metaphorically: make it so depressed it commits suicide.
  
  As per my answer to [this AI SE question](https://ai.stackexchange.com/questions/1768/could-a-paradox-kill-an-ai), the idea is to feed it a sequence of inputs that will cause it to become (permanently) inactive.
  
  The technical details of how this might be achieved (and they *are* somewhat technical) can be found in [this paper](https://arxiv.org/pdf/1606.00652.pdf).
  
  > **Comments:**
  > **username_3**: Out of interest, is there any evidence to suggest such a tactic might work?  
  > **username_2**: Even better - there is a proof. For the right choice of inputs, this is what is formally described in the original article.  
  
  ---
  
  ### Answer by username_4 on 2016-11-11. Score: 2
  
  If an AI is developed by humans, we surely can create another one!
  
  Develop another AI agent without all the possible bugs that can make it go rogue to tackle the rogue AI, but more technically advanced than the previous one. Hardwire it with the sole purpose of disabling any rogue AI agent that can harm humanity and have it **self-destruct** in case it is corrupted.
  
  If the AI is really strong, it can anticipate every move of human resistance, but it cannot fathom the mind of another AI agent.
  
  > **Comments:**
  > **username_3**: **"Hardwire it with the sole purpose of disabling any rogue AI agent that can harm humanity and have it self-destruct in case it is corrupted."** Sounds good in principle, but wouldn't you do something similar for the first one?  
  > **username_4**: Nope. We would have hardwired it with the sole purpose of whatever it was designed to do, like drive a car or something. We could, though, create one such AI in advance just for emergency.  
  
  ---
  
  