Answers.Body: <p>The concept of "the singularity" is when machines outsmart the humans. Although Stephen Hawking opinion is that this situation is inevitable, but I think it'll be very difficult to reach that point, because every A.I. algorithm needs to be programmed by humans, therefore it would be always more limited than its creator.</p>
  
  <p>We would probably know when that point when humanity will lose control over Artificial Intelligence where super-smart AI would be in competition with humans and maybe creating more sophisticated intelligent beings occurred, but currently, it's more like science fiction (aka <a href="https://en.wikipedia.org/wiki/Skynet_(Terminator)" rel="nofollow noreferrer">Terminator's Skynet</a>).</p>
  
  <p>The risk could involve killing people (like self-flying war <em>drones</em> making their own decision), destroying countries or even the whole planet (like A.I. connected to the nuclear weapons (aka <a href="https://en.wikipedia.org/wiki/WarGames" rel="nofollow noreferrer">WarGames</a> movie), but it doesn't prove the point that the machines would be smarter than humans.</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-03-02T12:09:08.290Z
Answers.Text: "every A.I. algorithm needs to be programmed by humans, therefore it would be always more limited than its creator" - this is interesting argument.followings are counter arguments -1)  we need not to code the intelligence of AI. we need to code the AI for ability to observe,infer and understand. After that, presumably, just adding sufficiently  more processing power and faster ones would make the AI able to learn and grasp better than us.2) Also, if 1000 humans apply their brain to build an AI, the AI may have more intelligence than 1 human.
Answers.UserDisplayName: akm
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-09-06T02:26:24.417Z
Answers.Text: Algorithms do NOT need to be programmed by humans. It is possible and actually somewhat common to transform, mutate, optimize, evaluate, and select algorithms; and machines already outsmart humans in some ways and quite frequently.
Answers.UserDisplayName: Douglas Daseeco
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-08-23T18:18:58.497Z
Answers.Text: ` every AI algorithm needs to be programmed by humans` -> The general idea behind AI is that machines can learn by improving their own programming. Theoretically, this could result in machines eventually becoming smarter than us, and being able to create algorithms superior to any algorithm written by humans, which in turn would result in still better AI.
Answers.UserDisplayName: John Slegers
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-08-02T16:04:57.997Z
Answers.LastActivityDate: 2018-04-11T16:38:28.877Z
Answers.LastEditDate: 2018-04-11T16:38:28.877Z
Answers.UserDisplayName: kenorb
Answers.Body: <p>The singularity, in the context of AI, is a theoretical event whereby an intelligent system with the following criteria is deployed.</p>
  
  <ol>
  <li>Capable of improving the range of its own intelligence or deploying another system with such improved range</li>
  <li>Willing or compelled to do so</li>
  <li>Able to do so in the absence of human supervision</li>
  <li>The improved version sustains criteria (1) through (3) recursively</li>
  </ol>
  
  <p>By induction, the theory then predicts that a sequence of events will be generated with a potential rate of intelligence increase that may vastly exceed the potential rate of brain evolution.</p>
  
  <p>How obligated this self-improving entity or population of procreated entities would be to preserve human life and liberty is indeterminate.  The idea that such an obligation can be part of an irrevocable software contract is naive in light of the nature of the capabilities tied to criteria (1) through (4) above.  As with other powerful technology, the risks are as numerous and far-reaching as the potential benefits.</p>
  
  <p>Risks to humanity do not require intelligence.  There are other contexts to the use of the term singularity, but they are outside of the scope of this AI forum but may be worth a brief mention for clarity.  Genetic engineering, nuclear engineering, globalization, and basing an international economy on a finite energy source being consumed thousands of times faster than it arose in the earth &mdash; These are other examples of high-risk technologies and mass trends that pose risks as well as benefits to humanity.</p>
  
  <p>Returning to AI, the major caveat in the singularity theory is its failure to incorporate probability.  Although it may be possible to develop an entity that conforms to criteria (1) through (4) above, it may be improbable enough so that the first event occurs long after all the current languages spoken on Earth are dead.</p>
  
  <p>On the other extreme of the probability distribution, one could easily argue that there is a nonzero probability that the first event already occurred.</p>
  
  <p>Along those lines, if a smarter presence where already existent on the Internet, how likely would it be that it would find it in its best interest to reveal itself to the lower human beings.  Do we introduce ourselves to a passing maggot?</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-10-27T15:27:57.897Z
Answers.Text: Thanks for the explanation. I have to admit I fail to grasp, conceptually, how these conditions would practically look like, especially 1). Presumably, an algorithm is implemented with a more or less defined set of inputs and outputs. Do we have to assume it alters those sets for 1) to be true? Why would any human developer choose to allow that, at least in an uncontrolled manner, even long before AGI level? And... is that a naive question? :)
Answers.UserDisplayName: Cpt Reynolds
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-09-04T18:42:02.433Z
Answers.LastActivityDate: 2018-04-12T02:23:08.880Z
Answers.LastEditDate: 2018-04-12T02:23:08.880Z
Answers.UserDisplayName: Douglas Daseeco
Answers.Body: <p>The "singularity," viewed narrowly, refers to a point at which economic growth is so fast that we can't make useful predictions about what the future past that point will look like.</p>
  
  <p>It's often used interchangeably with "intelligence explosion," which is when we get so-called Strong AI, which is AI that is intelligent enough to understand and improve itself. It seems reasonable to expect that the intelligence explosion would immediately lead to an economic singularity, but the reverse is not necessarily true.</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-08-02T16:23:13.273Z
Answers.LastActivityDate: 2016-08-02T16:23:13.273Z
Answers.UserDisplayName: Matthew Gray
Answers.Body: <p>The <a href="https://en.wikipedia.org/wiki/Technological_singularity" rel="nofollow noreferrer">technological singularity</a> is a theoretical point in time at which a <em>self-improving</em> <a href="https://en.wikipedia.org/wiki/Artificial_general_intelligence" rel="nofollow noreferrer">artificial general intelligence</a> becomes able to understand and manipulate concepts outside of the human brain's range, that is, the moment when it can understand things humans, by biological design, can't.</p>
  <p>The fuzziness about the singularity comes from the fact that, from the singularity onwards, history is effectively <em>unpredictable</em>. Humankind would be unable to predict any future events, or explain any present events, as science itself becomes incapable of describing machine-triggered events. Essentially, machines would think of us the same way we think of ants. Thus, we can make no predictions past the singularity. Furthermore, as a logical consequence, we'd be unable to define the point at which the singularity may occur at all, or even recognize it when it happens.</p>
  <p>However, in order for the singularity to take place, AGI needs to be developed, and <a href="https://en.wikipedia.org/wiki/Artificial_general_intelligence#Feasibility" rel="nofollow noreferrer">whether that is possible is quite a hot debate</a> right now. Moreover, an algorithm that creates <em>superhuman intelligence</em> (or <a href="https://en.wikipedia.org/wiki/Superintelligence" rel="nofollow noreferrer"><em>superintelligence</em></a>) out of bits and bytes would have to be designed. By definition, a human programmer wouldn't be able to do such a thing, as his/her brain would need to be able to comprehend concepts beyond its range. There is also the argument that an <a href="https://en.wikipedia.org/wiki/Technological_singularity#Intelligence_explosion" rel="nofollow noreferrer"><em>intelligence explosion</em></a> (the mechanism by which a technological singularity would theoretically be formed) would be impossible due to the difficulty of the design challenge of making itself more intelligent, getting larger proportionally to its intelligence, and that the difficulty of the design itself may overtake the intelligence required to solve the said challenge.</p>
  <p>Also, there are related theories involving <a href="https://en.wikipedia.org/wiki/AI_takeover" rel="nofollow noreferrer"><em>machines taking over humankind</em></a> and all of that sci-fi narrative. However, that's unlikely to happen, if <a href="https://en.wikipedia.org/wiki/Three_Laws_of_Robotics" rel="nofollow noreferrer">Asimov's laws</a> are followed appropriately. <a href="https://www.youtube.com/watch?app=desktop&amp;v=7PKx3kS7f4A" rel="nofollow noreferrer">Even if Asimov's laws were not enough</a>, a series of constraints would still be necessary in order to avoid the misuse of AGI by misintentioned individuals, and Asimov's laws are the nearest we have to that.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-05-19T17:28:20.503Z
Answers.Text: Asimov's Laws will never be encoded into a computer program, because they are simply too complicated.
Answers.UserDisplayName: Criticize SE actions means ban
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-08-02T16:49:20.210Z
Answers.Text: Regarding Asimov's laws, AFAIK, [the zeroth law](https://en.wikipedia.org/wiki/Three_Laws_of_Robotics#Zeroth_Law_added) was designed precisely to avoid the many ways that the three original laws were (ab)used in Asimov's stories. Anyway, an AI would definitively need to be constrained somehow, be it Asimov's laws or anything else, to avoid possible misuse of it and further havoc.
Answers.UserDisplayName: 3442
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2016-08-02T16:12:49.850Z
Answers.LastActivityDate: 2020-11-17T13:21:19.530Z
Answers.LastEditDate: 2020-11-17T13:21:19.530Z
Answers.UserDisplayName: 3442
Body: <p>I've heard the idea of the technological singularity, what is it and how does it relate to Artificial Intelligence? Is this the theoretical point where Artificial Intelligence machines have progressed to the point where they grow and learn on their own beyond what humans can do and their growth takes off?  How would we know when we reach this point?</p>
  
Tags: <philosophy><definitions><agi><superintelligence><singularity>
Title: What is the concept of the technological singularity?
UserDisplayName: WilliamKF
ThreadText: # What is the concept of the technological singularity?
  
  (Asked by: username_0 on 2016-08-02)
  
  I've heard the idea of the technological singularity, what is it and how does it relate to Artificial Intelligence? Is this the theoretical point where Artificial Intelligence machines have progressed to the point where they grow and learn on their own beyond what humans can do and their growth takes off? How would we know when we reach this point?
  
  **Tags:** philosophy, definitions, agi, superintelligence, singularity
  
  ---
  
  ## 4 answers
  
  ### Answer by username_7 on 2016-08-02. Score: 25 | Accepted answer
  
  The [technological singularity](https://en.wikipedia.org/wiki/Technological_singularity) is a theoretical point in time at which a *self-improving* [artificial general intelligence](https://en.wikipedia.org/wiki/Artificial_general_intelligence) becomes able to understand and manipulate concepts outside of the human brain's range, that is, the moment when it can understand things humans, by biological design, can't.
  
  The fuzziness about the singularity comes from the fact that, from the singularity onwards, history is effectively *unpredictable*. Humankind would be unable to predict any future events, or explain any present events, as science itself becomes incapable of describing machine-triggered events. Essentially, machines would think of us the same way we think of ants. Thus, we can make no predictions past the singularity. Furthermore, as a logical consequence, we'd be unable to define the point at which the singularity may occur at all, or even recognize it when it happens.
  
  However, in order for the singularity to take place, AGI needs to be developed, and [whether that is possible is quite a hot debate](https://en.wikipedia.org/wiki/Artificial_general_intelligence#Feasibility) right now. Moreover, an algorithm that creates *superhuman intelligence* (or [*superintelligence*](https://en.wikipedia.org/wiki/Superintelligence)) out of bits and bytes would have to be designed. By definition, a human programmer wouldn't be able to do such a thing, as his/her brain would need to be able to comprehend concepts beyond its range. There is also the argument that an [*intelligence explosion*](https://en.wikipedia.org/wiki/Technological_singularity#Intelligence_explosion) (the mechanism by which a technological singularity would theoretically be formed) would be impossible due to the difficulty of the design challenge of making itself more intelligent, getting larger proportionally to its intelligence, and that the difficulty of the design itself may overtake the intelligence required to solve the said challenge.
  
  Also, there are related theories involving [*machines taking over humankind*](https://en.wikipedia.org/wiki/AI_takeover) and all of that sci-fi narrative. However, that's unlikely to happen, if [Asimov's laws](https://en.wikipedia.org/wiki/Three_Laws_of_Robotics) are followed appropriately. [Even if Asimov's laws were not enough](https://www.youtube.com/watch?app=desktop&v=7PKx3kS7f4A), a series of constraints would still be necessary in order to avoid the misuse of AGI by misintentioned individuals, and Asimov's laws are the nearest we have to that.
  
  > **Comments:**
  > **username_7**: Regarding Asimov's laws, AFAIK, [the zeroth law](https://en.wikipedia.org/wiki/Three_Laws_of_Robotics#Zeroth_Law_added) was designed precisely to avoid the many ways that the three original laws were (ab)used in Asimov's stories. Anyway, an AI would definitively need to be constrained somehow, be it Asimov's laws or anything else, to avoid possible misuse of it and further havoc.  
  > **username_8**: Asimov's Laws will never be encoded into a computer program, because they are simply too complicated.  
  
  ---
  
  ### Answer by username_1 on 2016-08-02. Score: 3
  
  The concept of "the singularity" is when machines outsmart the humans. Although Stephen Hawking opinion is that this situation is inevitable, but I think it'll be very difficult to reach that point, because every A.I. algorithm needs to be programmed by humans, therefore it would be always more limited than its creator.
  
  We would probably know when that point when humanity will lose control over Artificial Intelligence where super-smart AI would be in competition with humans and maybe creating more sophisticated intelligent beings occurred, but currently, it's more like science fiction (aka [Terminator's Skynet](https://en.wikipedia.org/wiki/Skynet_(Terminator))).
  
  The risk could involve killing people (like self-flying war *drones* making their own decision), destroying countries or even the whole planet (like A.I. connected to the nuclear weapons (aka [WarGames](https://en.wikipedia.org/wiki/WarGames) movie), but it doesn't prove the point that the machines would be smarter than humans.
  
  > **Comments:**
  > **username_4**: ` every AI algorithm needs to be programmed by humans` -> The general idea behind AI is that machines can learn by improving their own programming. Theoretically, this could result in machines eventually becoming smarter than us, and being able to create algorithms superior to any algorithm written by humans, which in turn would result in still better AI.  
  > **username_2**: "every A.I. algorithm needs to be programmed by humans, therefore it would be always more limited than its creator" - this is interesting argument.followings are counter arguments -1)  we need not to code the intelligence of AI. we need to code the AI for ability to observe,infer and understand. After that, presumably, just adding sufficiently  more processing power and faster ones would make the AI able to learn and grasp better than us.2) Also, if 1000 humans apply their brain to build an AI, the AI may have more intelligence than 1 human.  
  > **username_3**: Algorithms do NOT need to be programmed by humans. It is possible and actually somewhat common to transform, mutate, optimize, evaluate, and select algorithms; and machines already outsmart humans in some ways and quite frequently.  
  
  ---
  
  ### Answer by username_3 on 2017-09-04. Score: 3
  
  The singularity, in the context of AI, is a theoretical event whereby an intelligent system with the following criteria is deployed.
  
  1. Capable of improving the range of its own intelligence or deploying another system with such improved range
  2. Willing or compelled to do so
  3. Able to do so in the absence of human supervision
  4. The improved version sustains criteria (1) through (3) recursively
  
  By induction, the theory then predicts that a sequence of events will be generated with a potential rate of intelligence increase that may vastly exceed the potential rate of brain evolution.
  
  How obligated this self-improving entity or population of procreated entities would be to preserve human life and liberty is indeterminate. The idea that such an obligation can be part of an irrevocable software contract is naive in light of the nature of the capabilities tied to criteria (1) through (4) above. As with other powerful technology, the risks are as numerous and far-reaching as the potential benefits.
  
  Risks to humanity do not require intelligence. There are other contexts to the use of the term singularity, but they are outside of the scope of this AI forum but may be worth a brief mention for clarity. Genetic engineering, nuclear engineering, globalization, and basing an international economy on a finite energy source being consumed thousands of times faster than it arose in the earth — These are other examples of high-risk technologies and mass trends that pose risks as well as benefits to humanity.
  
  Returning to AI, the major caveat in the singularity theory is its failure to incorporate probability. Although it may be possible to develop an entity that conforms to criteria (1) through (4) above, it may be improbable enough so that the first event occurs long after all the current languages spoken on Earth are dead.
  
  On the other extreme of the probability distribution, one could easily argue that there is a nonzero probability that the first event already occurred.
  
  Along those lines, if a smarter presence where already existent on the Internet, how likely would it be that it would find it in its best interest to reveal itself to the lower human beings. Do we introduce ourselves to a passing maggot?
  
  > **Comments:**
  > **username_5**: Thanks for the explanation. I have to admit I fail to grasp, conceptually, how these conditions would practically look like, especially 1). Presumably, an algorithm is implemented with a more or less defined set of inputs and outputs. Do we have to assume it alters those sets for 1) to be true? Why would any human developer choose to allow that, at least in an uncontrolled manner, even long before AGI level? And... is that a naive question? :)  
  
  ---
  
  ### Answer by username_6 on 2016-08-02. Score: 1
  
  The "singularity," viewed narrowly, refers to a point at which economic growth is so fast that we can't make useful predictions about what the future past that point will look like.
  
  It's often used interchangeably with "intelligence explosion," which is when we get so-called Strong AI, which is AI that is intelligent enough to understand and improve itself. It seems reasonable to expect that the intelligence explosion would immediately lead to an economic singularity, but the reverse is not necessarily true.
  
  
  ---
  
  