Answers.Body: <p>It seems impossible to prevent that. If someone can make a safe AI from scratch in the near future, then someone else can make a dangerous AI from scratch as well. If all that's needed is a computer (or eventually a robot) it will be really hard to stop people from creating one.</p>
  
  <p>Banning computers? Maybe it could prevent it, but that comes with quite a few negative sides as well.</p>
  
  <p>A law against creating AIs? Would be really hard to follow-up, and what about the AIs people want to make to be used for something "good"?</p>
  
  <p>And even if we could come up with a good set of laws they probably wouldn't be introduced in all countries, and also be really hard to follow up.</p>
  
  <p>I guess we just need to make our own defence mechanisms which can fight unsafe AIs (physically or virtually) when that time comes.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2018-08-16T08:02:23.197Z
Answers.LastActivityDate: 2018-08-16T08:02:23.197Z
Answers.UserDisplayName: Mr. Eivind
Body: <p>Nowadays we don't know how to create AI in a safe way (I think that we don't even know yet how to define a safe AI), but there is a lot of research in developing a model allowing it. </p>
  
  <p>Let's say, that someday we discover such a model (maybe even it would be possible to mathematically prove its safety). Is it rational to ask, how do we prevent people from creating AI outside of this model (e.g. they are so confident in their own model, that they just pursue it and end up with something like <code>paperclip scenario</code>)? </p>
  
  <p>Should we also think about creating some theory/infrastructure preventing such a scenario?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2018-08-11T11:48:51.790Z
Comments.Text: "Nowadays we don't know how to create AI in a safe way" Nowadays we don't know how to create AI, dot. Current talks about rules to impose an unknown control model to unknown AIs are not empirical, not scientific, not true research.
Comments.UserDisplayName: pasaba por aqui
Tags: <philosophy><ai-safety>
Title: Is it necessarry to create theory/infrastructure to prevent people from creating AI incompatible with a safe model (if we create one)?
UserDisplayName: brzepkowski
ThreadText: # Is it necessarry to create theory/infrastructure to prevent people from creating AI incompatible with a safe model (if we create one)?
  
  (Asked by: username_0 on 2018-08-10)
  
  Nowadays we don't know how to create AI in a safe way (I think that we don't even know yet how to define a safe AI), but there is a lot of research in developing a model allowing it.
  
  Let's say, that someday we discover such a model (maybe even it would be possible to mathematically prove its safety). Is it rational to ask, how do we prevent people from creating AI outside of this model (e.g. they are so confident in their own model, that they just pursue it and end up with something like `paperclip scenario`)?
  
  Should we also think about creating some theory/infrastructure preventing such a scenario?
  
  **Tags:** philosophy, ai-safety
  
  > **Comments:**
  > **username_1**: "Nowadays we don't know how to create AI in a safe way" Nowadays we don't know how to create AI, dot. Current talks about rules to impose an unknown control model to unknown AIs are not empirical, not scientific, not true research.  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_2 on 2018-08-16. Score: 1
  
  It seems impossible to prevent that. If someone can make a safe AI from scratch in the near future, then someone else can make a dangerous AI from scratch as well. If all that's needed is a computer (or eventually a robot) it will be really hard to stop people from creating one.
  
  Banning computers? Maybe it could prevent it, but that comes with quite a few negative sides as well.
  
  A law against creating AIs? Would be really hard to follow-up, and what about the AIs people want to make to be used for something "good"?
  
  And even if we could come up with a good set of laws they probably wouldn't be introduced in all countries, and also be really hard to follow up.
  
  I guess we just need to make our own defence mechanisms which can fight unsafe AIs (physically or virtually) when that time comes.
  
  
  ---
  
  