Answers.Body: <p>Your problem closely resembles John Searle's "Chinese Room" argument, which claimed that one (or more) abstract "intelligence tests" lack the discriminitive ability to distinguish between a trivial simulation of intelligence and The Real Thing.</p>
  
  <p>Thus the success of an AI at one (or more) synthetic cognitive test(s) (like the Turing Test, or the games of chess or go) should be seen as insufficient as a surrogate threshold target equal to human-level intelligence.  The implication is that a sufficient AI test must require deeper understanding of a problem space from the AI than would be needed to "simply" manipulate (Chinese character) symbols, or play around cleverly but meaninglessly with English words in a convincing manner, as bots have done for years when competing in Turing Test competitions.</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-05-22T20:22:12.983Z
Answers.LastActivityDate: 2017-05-22T20:22:12.983Z
Answers.UserDisplayName: Randy
Answers.Body: <p>If something is indistinguishable from a human it is as intelligent as a human. There is no such thing as simulated intelligence. </p>
  
  <p>Consciousness of course is a different matter and I suspect that's what you really have in mind (no pun intended). </p>
  
  <p>The question how to distinguish somebody who is truly conscious from somebody who just acts outwardly like a conscious being is often discussed under the term <a href="https://en.wikipedia.org/wiki/Philosophical_zombie" rel="nofollow noreferrer">philosophical zombie</a>.</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-05-22T10:42:42.427Z
Answers.LastActivityDate: 2017-05-22T10:42:42.427Z
Answers.UserDisplayName: BlindKungFuMaster
Body: <p>Expressed in my own words:</p>
  
  <blockquote>
    <p>Suppose we create something that passes all of our tests and is
    indistinguishable from another human. How can you know if this is
    truly a conscious being as a human is, or simply a simulation of
    conscience?</p>
  </blockquote>
  
  <p>What is the name for this? Where was it first written about?</p>
  
Tags: <philosophy><agi><intelligence-testing><self-awareness><chinese-room-argument>
Title: Is there a formal name for this philosophical AI problem?
UserDisplayName: Tim Atkinson
ThreadText: # Is there a formal name for this philosophical AI problem?
  
  (Asked by: username_0 on 2017-05-22)
  
  Expressed in my own words:
  
  > Suppose we create something that passes all of our tests and is
  > indistinguishable from another human. How can you know if this is
  > truly a conscious being as a human is, or simply a simulation of
  > conscience?
  
  What is the name for this? Where was it first written about?
  
  **Tags:** philosophy, agi, intelligence-testing, self-awareness, chinese-room-argument
  
  ---
  
  ## 2 answers
  
  ### Answer by username_1 on 2017-05-22. Score: 1
  
  Your problem closely resembles John Searle's "Chinese Room" argument, which claimed that one (or more) abstract "intelligence tests" lack the discriminitive ability to distinguish between a trivial simulation of intelligence and The Real Thing.
  
  Thus the success of an AI at one (or more) synthetic cognitive test(s) (like the Turing Test, or the games of chess or go) should be seen as insufficient as a surrogate threshold target equal to human-level intelligence. The implication is that a sufficient AI test must require deeper understanding of a problem space from the AI than would be needed to "simply" manipulate (Chinese character) symbols, or play around cleverly but meaninglessly with English words in a convincing manner, as bots have done for years when competing in Turing Test competitions.
  
  
  ---
  
  ### Answer by username_2 on 2017-05-22. Score: 1
  
  If something is indistinguishable from a human it is as intelligent as a human. There is no such thing as simulated intelligence.
  
  Consciousness of course is a different matter and I suspect that's what you really have in mind (no pun intended).
  
  The question how to distinguish somebody who is truly conscious from somebody who just acts outwardly like a conscious being is often discussed under the term [philosophical zombie](https://en.wikipedia.org/wiki/Philosophical_zombie).
  
  
  ---
  
  