Answers.Body: <p>Shane Legg and Marcus Hutter <a href="http://www.vetta.org/documents/42.pdf" rel="nofollow noreferrer">proposed one</a> in 2006. The main descriptive quotes (see the paper for the actual formula):</p>
  <blockquote>
  <p>Intelligence measures an agent’s general ability to achieve goals in a wide range of environments</p>
  <p>...</p>
  <p>It is clear by construction that universal intelligence measures the general ability of an agent to perform well in a very wide range of environments, as required by our informal definition of intelligence given earlier. The definition places no restrictions on the internal workings of the agent; it only requires that the agent is capable of generating output and receiving input which includes a reward signal.</p>
  </blockquote>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-08-06T14:17:28.310Z
Answers.LastActivityDate: 2016-08-06T14:17:28.310Z
Answers.LastEditDate: 2020-06-17T09:57:20.710Z
Answers.UserDisplayName: Matthew Gray
Answers.Body: <p>One of the challenges of AI is defining Intelligence.
  If we could precisely define general intelligence then we could program it into a computer. After all an algorithm is a process so well defined that it can be run on a computer.</p>
  
  <p>Narrow AI can be evaluated on its success at achieving goals in an environment. In domains such as computer vision and speech recognition narrow AI algorithms can be easily evaluated.</p>
  
  <p>Many universities curate narrow AI tests. Fei-Fei Li a professor at Stanford who directs the Artificial Intelligence lab there organises the annual ImageNet Challenge. In 2012 Geoffrey Hinton famously won the competition by building a Deep Neural Network that could recognize pictures more accurately than humans can.</p>
  
  <p>To my knowledge the testers commonly use <a href="https://en.wikipedia.org/wiki/Precision_and_recall" rel="nofollow">Precision and recall</a> evaluation metrics</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-08-06T11:57:19.053Z
Answers.LastActivityDate: 2016-08-06T14:07:22.407Z
Answers.LastEditDate: 2016-08-06T14:07:22.407Z
Answers.UserDisplayName: Conor Cosnett
Answers.Body: <p>One thing you'll see quite often, is to declare a correspondence between a system and a human of a given age.  For example "this program can answer questions about science approximately as well as an average 7 year old" or something of that nature.  </p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-08-08T18:25:11.147Z
Answers.LastActivityDate: 2016-08-08T18:25:11.147Z
Answers.UserDisplayName: mindcrime
Body: <p>We can measure the power of the machine with the number of operation per second or the frequency of the processor. But does units similar of IQ for humans exist for a AI?<br/>
  I'm asking for a unit which can give countable result so something different from a Turing Test which only give a binary result.</p>
  
Tags: <machine-learning><classification><intelligence-testing>
Title: Do specific units exists for measuring the intelligence of a machine?
UserDisplayName: latmos
ThreadText: # Do specific units exists for measuring the intelligence of a machine?
  
  (Asked by: username_0 on 2016-08-06)
  
  We can measure the power of the machine with the number of operation per second or the frequency of the processor. But does units similar of IQ for humans exist for a AI?  
  I'm asking for a unit which can give countable result so something different from a Turing Test which only give a binary result.
  
  **Tags:** machine-learning, classification, intelligence-testing
  
  
  ---
  
  ## 3 answers
  
  ### Answer by username_1 on 2016-08-06. Score: 3
  
  Shane Legg and Marcus Hutter [proposed one](http://www.vetta.org/documents/42.pdf) in 2006. The main descriptive quotes (see the paper for the actual formula):
  
  > Intelligence measures an agent’s general ability to achieve goals in a wide range of environments
  >
  > ...
  >
  > It is clear by construction that universal intelligence measures the general ability of an agent to perform well in a very wide range of environments, as required by our informal definition of intelligence given earlier. The definition places no restrictions on the internal workings of the agent; it only requires that the agent is capable of generating output and receiving input which includes a reward signal.
  
  
  ---
  
  ### Answer by username_2 on 2016-08-06. Score: 3
  
  One of the challenges of AI is defining Intelligence.
  If we could precisely define general intelligence then we could program it into a computer. After all an algorithm is a process so well defined that it can be run on a computer.
  
  Narrow AI can be evaluated on its success at achieving goals in an environment. In domains such as computer vision and speech recognition narrow AI algorithms can be easily evaluated.
  
  Many universities curate narrow AI tests. Fei-Fei Li a professor at Stanford who directs the Artificial Intelligence lab there organises the annual ImageNet Challenge. In 2012 Geoffrey Hinton famously won the competition by building a Deep Neural Network that could recognize pictures more accurately than humans can.
  
  To my knowledge the testers commonly use [Precision and recall](https://en.wikipedia.org/wiki/Precision_and_recall) evaluation metrics
  
  
  ---
  
  ### Answer by username_3 on 2016-08-08. Score: 0
  
  One thing you'll see quite often, is to declare a correspondence between a system and a human of a given age. For example "this program can answer questions about science approximately as well as an average 7 year old" or something of that nature.
  
  
  ---
  
  