Answers.Body: <p>Winograd Schema Challenge</p>
  <p>ImageNet Classification Challenge</p>
  <p>General Video Game AI (GVGAI) Competition</p>
  <p>RoboCup Soccer</p>
  <p>Stanford Question Answering Dataset (SQuAD)</p>
  <p>VQA (Visual Question Answering) Challenge</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-12-14T09:31:04.473Z
Answers.Text: This could do with some background discussion, and clarification that these are more narrow targetted AI tests compared to the Turing Test - some narrower than others. A brief description of each one would be good, too, and/or a link to the official sites for the tests
Answers.UserDisplayName: Neil Slater
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-12-14T09:15:21.440Z
Answers.LastActivityDate: 2023-12-14T09:15:21.440Z
Answers.UserDisplayName: han
Body: <p>Which objective and measurable tests have been developed to test the intelligence of AI? </p>
  
  <p>The classical test is the Turing Test, which has objective criteria and is measurable since it can be measured what percentage of the jury is fooled by the AI.</p>
  
  <p>I am looking for other, more modern tests. </p>
  
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2016-08-04T03:35:26.833Z
Comments.Text: I voted to close this question since there are many different possible ways to develop tests with objective criteria and measurability, and it'd be hard to mention them all exhaustively. I would recommend reading this article about [a proposed plan to replace the Turing Test with an "Olympics"](http://motherboard.vice.com/read/the-plan-to-replace-the-turing-test-with-a-turing-olympics) and this blog post about [the Lovelace Tests](http://www.smithsonianmag.com/smart-news/turing-test-computer-intelligence-too-easy-test-would-look-computer-creativity-180953640/?no-ist)...
Comments.UserDisplayName: Left SE On 10_6_19
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2016-08-04T03:36:38.770Z
Comments.Text: ...for a good sense of how such 'objective' and measurable tests are designed in the modern day. But just because these tests can be objective doesn't mean that the results can be valid or useful to have. After all, even the Turing Test itself can be arguably beaten, which is why we have proposals for alternatives to the Turing Test.
Comments.UserDisplayName: Left SE On 10_6_19
Tags: <intelligence-testing>
Title: Which objective tests have been developed to test the intelligence of AI?
UserDisplayName: wythagoras
ThreadText: # Which objective tests have been developed to test the intelligence of AI?
  
  (Asked by: username_0 on 2016-08-03)
  
  Which objective and measurable tests have been developed to test the intelligence of AI?
  
  The classical test is the Turing Test, which has objective criteria and is measurable since it can be measured what percentage of the jury is fooled by the AI.
  
  I am looking for other, more modern tests.
  
  **Tags:** intelligence-testing
  
  > **Comments:**
  > **username_1**: I voted to close this question since there are many different possible ways to develop tests with objective criteria and measurability, and it'd be hard to mention them all exhaustively. I would recommend reading this article about [a proposed plan to replace the Turing Test with an "Olympics"](http://motherboard.vice.com/read/the-plan-to-replace-the-turing-test-with-a-turing-olympics) and this blog post about [the Lovelace Tests](http://www.smithsonianmag.com/smart-news/turing-test-computer-intelligence-too-easy-test-would-look-computer-creativity-180953640/?no-ist)...  
  > **username_1**: ...for a good sense of how such 'objective' and measurable tests are designed in the modern day. But just because these tests can be objective doesn't mean that the results can be valid or useful to have. After all, even the Turing Test itself can be arguably beaten, which is why we have proposals for alternatives to the Turing Test.  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_2 on 2023-12-14. Score: 0
  
  Winograd Schema Challenge
  
  ImageNet Classification Challenge
  
  General Video Game AI (GVGAI) Competition
  
  RoboCup Soccer
  
  Stanford Question Answering Dataset (SQuAD)
  
  VQA (Visual Question Answering) Challenge
  
  > **Comments:**
  > **username_3**: This could do with some background discussion, and clarification that these are more narrow targetted AI tests compared to the Turing Test - some narrower than others. A brief description of each one would be good, too, and/or a link to the official sites for the tests  
  
  ---
  
  