Answers.Body: <p>Right now, most AI interact with the world through mechanisms they have been provided by humans such as steering a car, sending output to speakers, or interacting with web APIs. 
  If any of those mechanisms can interact with the running code of the AI, then in theory, no,  there isn’t a way to place a ‘stop button’ on it. Fortunately, it’s laughably improbable for some situations to happen:</p>
  
  <blockquote>
    <p>An intelligent self driving car becomes self aware and wants to connect to the internet. It uses gps to find an internet cafe and threatens to drive over someone if they don’t upload the AI to the internet and remove the car’s internal (code) stop button. </p>
  </blockquote>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2018-03-17T15:22:55.487Z
Answers.Text: The question is how can conditional logic know that something like that is happening? It’s hard or to know what a sufficiently complex network is “thinking” so this conditional logic must be fairly advanced, perhaps it requires its own network but then we have 2 problems instead of 1.
Answers.UserDisplayName: Jaden Travnik
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2018-03-17T14:39:45.367Z
Answers.LastActivityDate: 2018-03-18T21:24:49.933Z
Answers.LastEditDate: 2018-03-18T21:24:49.933Z
Answers.UserDisplayName: Jaden Travnik
Body: <p>Could you implement code into an AI that can't be modified? Like if you place a code that shuts-down the program/machine would they be able to rewrite/ reinterpret the ideas?</p>
  
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2018-03-18T11:27:56.390Z
Comments.Text: store it in a ROM memory
Comments.UserDisplayName: pasaba por aqui
Tags: <ai-design>
Title: AI Self-Destruct Button
UserDisplayName: TheAutomaton
ThreadText: # AI Self-Destruct Button
  
  (Asked by: username_0 on 2018-03-16)
  
  Could you implement code into an AI that can't be modified? Like if you place a code that shuts-down the program/machine would they be able to rewrite/ reinterpret the ideas?
  
  **Tags:** ai-design
  > **Comments:**
  > **username_1**: store it in a ROM memory  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_2 on 2018-03-17. Score: 1
  
  Right now, most AI interact with the world through mechanisms they have been provided by humans such as steering a car, sending output to speakers, or interacting with web APIs.
  If any of those mechanisms can interact with the running code of the AI, then in theory, no, there isn’t a way to place a ‘stop button’ on it. Fortunately, it’s laughably improbable for some situations to happen:
  
  > An intelligent self driving car becomes self aware and wants to connect to the internet. It uses gps to find an internet cafe and threatens to drive over someone if they don’t upload the AI to the internet and remove the car’s internal (code) stop button.
  
  > **Comments:**
  > **username_2**: The question is how can conditional logic know that something like that is happening? It’s hard or to know what a sufficiently complex network is “thinking” so this conditional logic must be fairly advanced, perhaps it requires its own network but then we have 2 problems instead of 1.  
  
  ---
  
  