Answers.Body: <p>I am assuming by AI you mean AG(eneral)I, not machine learning or expert systems tuned for specific tasks.</p>
  
  <p>In addition to @mindcrime's answer, sometimes we run out of samples to train and sometimes computers became so slow to process enough samples to work in manageable timescales. @bpachev mentioned memory but on the surface, our supercomputers have more than enough memory to store a human brain matrix. But we lack the ability to simulate it real time. After we are able to do that, we also need to connect external input, even more processing power is required for that. Even that would not be enough to simulate a human brain fully as biochemistry plays an important role. </p>
  
  <p>One final note would be there is little incentive to develop AGI other than understanding how the human mind works. There are classification algorithms, expert systems, knowledge engines that can out-perform even the best humans for specific tasks.</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-08-09T18:58:53.330Z
Answers.Text: Regarding your last note, you seem to imply that understanding the human mind and human cognition is of little value outside of itself. Couldn't AGI systems be used to help treat patients with considerable brain damage and memory loss or with interacting the brain with mechanical appendages? It seems that if we can create a truly genuine AGI, we will have answered one of the questions that has plagued mankind for millennia and would have countless applications *outside* of just an intellectual pursuit.
Answers.UserDisplayName: callyalater
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-08-09T18:59:11.410Z
Answers.Text: But I do agree with you that specialized expert systems are invaluable resources to us apart from creating AGI.
Answers.UserDisplayName: callyalater
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-08-09T20:34:15.087Z
Answers.Text: Understanding how human mind works is not only intellectual pursuit, it has medical implications as you stated. But, not just brain damage and memory loss, but psychological as well. Solving PTSD or OCD will have great positive effect on society. On the other hand, it will have military applications. Why interrogate someone when you can extract the info from their brain, right?
Answers.UserDisplayName: Cem Kalyoncu
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-08-09T20:35:55.257Z
Answers.Text: This seems like a great topic for another question: What are the ethical implications for creating a genuine AGI?
Answers.UserDisplayName: callyalater
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-08-08T19:11:47.130Z
Answers.LastActivityDate: 2018-04-12T02:23:19.220Z
Answers.LastEditDate: 2018-04-12T02:23:19.220Z
Answers.UserDisplayName: Cem Kalyoncu
Answers.Body: <p>One obstacle to the development of AI is the fundamental limitations of computer memory. Computers, at a fundamental level, can only work with bits. This limits the type of information that they can describe.</p>
  
  <p>EDIT:</p>
  
  <p>The precise nature and complexity of human memory isn't fully understood, but I would argue that at the very least, human memory is well adapted for the types of tasks that humans perform. Thus, computer memory, even if theoretically capable of representing everything that human memory can, is  probably inefficient and poorly structured for such a task.  </p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-08-06T17:35:58.410Z
Answers.Text: Neoromorphic memory indexing schemes, such as Kanerva's 'Sparse Distributed Memory', have been around for a while.
Answers.UserDisplayName: NietzscheanAI
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-08-07T13:37:19.487Z
Answers.Text: You'd have to be more specific about what you mean with "The human brain encodes information with chemicals". Information is encoded in the brain through changes in the neurons connections to one another and not through the neurotransmitters themselves. However in the end it can be loosely modeled as being a single "weight" value per connection, thus the idea that chemicals encode information in a more complicated fashion than bits would appear to be incorrect.
Answers.UserDisplayName: tomzx
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-08-08T17:27:46.157Z
Answers.Text: @tomzx Thanks for your feedback. It was my understanding that human memory isn't well understood, but that due to the chemical nature of the brain, memory was represented chemically. I'll edit my answer to be less speculative.
Answers.UserDisplayName: bpachev
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-08-05T20:08:43.130Z
Answers.LastActivityDate: 2016-08-08T17:36:35.903Z
Answers.LastEditDate: 2016-08-08T17:36:35.903Z
Answers.UserDisplayName: bpachev
Answers.Body: <ol>
  <li><p>we don't really know what intelligence is.</p></li>
  <li><p>we don't truly understand the best model of intelligence we have available (human intelligence) works.</p></li>
  <li><p>we're trying to replicate human intelligence (to some extent) on hardware which is quite different from the hardware it runs on in reality.</p></li>
  <li><p>the human brain (our best model of intelligence) is mostly a black-box to us, and it's difficult to probe/introspect its operation without killing the test subject.  This is, of course, unethical and illegal. So progress in understanding the brain is very slow. </p></li>
  </ol>
  
  <p>Combine those factors and you can understand why it's difficult to make progress in AI. In many ways, you can argue that we're shooting in the dark. Of course, we have made <em>some</em> progress, so we know we're getting some things right. But without a real comprehensive theory about <em>how</em> AI should/will work, we are reduced to a lot of trial and error and iteration to move forward.</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-08-08T18:08:26.123Z
Answers.LastActivityDate: 2018-04-12T02:34:45.870Z
Answers.LastEditDate: 2018-04-12T02:34:45.870Z
Answers.UserDisplayName: mindcrime
Body: <p>I have a background in Computer Engineering and have been working on developing better algorithms to mimic human thought. (One of my favorites is Analogical Modeling as applied to language processing and decision making.) However, the more I research, the more I realize just <em>how</em> complicated AI is.</p>
  
  <p>I have tried to tackle many problems in this field, but sometimes I find that I am reinventing the wheel or am trying to solve a problem that has already been proven to be unsolvable (ie. the halting problem). So, to help in furthering AI, I want to better understand the current obstacles that are hindering our progress in this field.</p>
  
  <p>For example, time and space complexity of some machine learning algorithms is super-polynomial which means that even with fast computers, it can take a while for the program to complete. Even still, some algorithms may be fast on a desktop or other computer while dealing with a small data set, but when increasing the size of the data, the algorithm becomes intractable.</p>
  
  <p>What are other issues currently facing AI development?</p>
  
Tags: <machine-learning>
Title: What are the main problems hindering current AI development?
UserDisplayName: callyalater
ThreadText: # What are the main problems hindering current AI development?
  
  (Asked by: username_0 on 2016-08-02)
  
  I have a background in Computer Engineering and have been working on developing better algorithms to mimic human thought. (One of my favorites is Analogical Modeling as applied to language processing and decision making.) However, the more I research, the more I realize just *how* complicated AI is.
  
  I have tried to tackle many problems in this field, but sometimes I find that I am reinventing the wheel or am trying to solve a problem that has already been proven to be unsolvable (ie. the halting problem). So, to help in furthering AI, I want to better understand the current obstacles that are hindering our progress in this field.
  
  For example, time and space complexity of some machine learning algorithms is super-polynomial which means that even with fast computers, it can take a while for the program to complete. Even still, some algorithms may be fast on a desktop or other computer while dealing with a small data set, but when increasing the size of the data, the algorithm becomes intractable.
  
  What are other issues currently facing AI development?
  
  **Tags:** machine-learning
  
  ---
  
  ## 3 answers
  
  ### Answer by username_5 on 2016-08-08. Score: 7 | Accepted answer
  
  1. we don't really know what intelligence is.
  2. we don't truly understand the best model of intelligence we have available (human intelligence) works.
  3. we're trying to replicate human intelligence (to some extent) on hardware which is quite different from the hardware it runs on in reality.
  4. the human brain (our best model of intelligence) is mostly a black-box to us, and it's difficult to probe/introspect its operation without killing the test subject. This is, of course, unethical and illegal. So progress in understanding the brain is very slow.
  
  Combine those factors and you can understand why it's difficult to make progress in AI. In many ways, you can argue that we're shooting in the dark. Of course, we have made *some* progress, so we know we're getting some things right. But without a real comprehensive theory about *how* AI should/will work, we are reduced to a lot of trial and error and iteration to move forward.
  
  
  ---
  
  ### Answer by username_1 on 2016-08-08. Score: 3
  
  I am assuming by AI you mean AG(eneral)I, not machine learning or expert systems tuned for specific tasks.
  
  In addition to @mindcrime's answer, sometimes we run out of samples to train and sometimes computers became so slow to process enough samples to work in manageable timescales. @bpachev mentioned memory but on the surface, our supercomputers have more than enough memory to store a human brain matrix. But we lack the ability to simulate it real time. After we are able to do that, we also need to connect external input, even more processing power is required for that. Even that would not be enough to simulate a human brain fully as biochemistry plays an important role.
  
  One final note would be there is little incentive to develop AGI other than understanding how the human mind works. There are classification algorithms, expert systems, knowledge engines that can out-perform even the best humans for specific tasks.
  
  > **Comments:**
  > **username_0**: Regarding your last note, you seem to imply that understanding the human mind and human cognition is of little value outside of itself. Couldn't AGI systems be used to help treat patients with considerable brain damage and memory loss or with interacting the brain with mechanical appendages? It seems that if we can create a truly genuine AGI, we will have answered one of the questions that has plagued mankind for millennia and would have countless applications *outside* of just an intellectual pursuit.  
  > **username_0**: But I do agree with you that specialized expert systems are invaluable resources to us apart from creating AGI.  
  > **username_1**: Understanding how human mind works is not only intellectual pursuit, it has medical implications as you stated. But, not just brain damage and memory loss, but psychological as well. Solving PTSD or OCD will have great positive effect on society. On the other hand, it will have military applications. Why interrogate someone when you can extract the info from their brain, right?  
  > **username_0**: This seems like a great topic for another question: What are the ethical implications for creating a genuine AGI?  
  
  ---
  
  ### Answer by username_2 on 2016-08-05. Score: -2
  
  One obstacle to the development of AI is the fundamental limitations of computer memory. Computers, at a fundamental level, can only work with bits. This limits the type of information that they can describe.
  
  EDIT:
  
  The precise nature and complexity of human memory isn't fully understood, but I would argue that at the very least, human memory is well adapted for the types of tasks that humans perform. Thus, computer memory, even if theoretically capable of representing everything that human memory can, is probably inefficient and poorly structured for such a task.
  
  > **Comments:**
  > **username_3**: Neoromorphic memory indexing schemes, such as Kanerva's 'Sparse Distributed Memory', have been around for a while.  
  > **username_4**: You'd have to be more specific about what you mean with "The human brain encodes information with chemicals". Information is encoded in the brain through changes in the neurons connections to one another and not through the neurotransmitters themselves. However in the end it can be loosely modeled as being a single "weight" value per connection, thus the idea that chemicals encode information in a more complicated fashion than bits would appear to be incorrect.  
  > **username_2**: @tomzx Thanks for your feedback. It was my understanding that human memory isn't well understood, but that due to the chemical nature of the brain, memory was represented chemically. I'll edit my answer to be less speculative.  
  
  ---
  
  