Answers.Body: <p>By the cognitive science / psychology literature, we don't have a theory of consciousness, or a measure of sentience. By its very nature, "things" like those can only be understood with respect to ones own subjective experience (as in you can only understand consciousness by comparing it to your own conscious experience).</p>
  
  <p>So no, even if we have a device that perfectly replicates the function of consciousness or sentience, we'd still have a hard time saying that it conclusively is indeed consciousness.</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-11-20T02:01:09.333Z
Answers.Text: It will be interesting to see the types of tests that come out of the cognitive science field, should such systems emerge.  I suspect the question will remain in the area of metaphysics for a good long time, regardless.  The better sci-fi authors/philosophers have grappled with this question, Phillip Dick in particular.  In some ways, you might cast his view in context of the "[Duck Test](https://en.wikipedia.org/wiki/Duck_test)". *(I wouldn't be surprised if there is strong sentiment for the idea that "if it talks like a person, and acts like a person, then it's probably a person";)*
Answers.UserDisplayName: DukeZhou
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-11-23T01:53:03.597Z
Answers.Text: it's also quite hard to agree even on living systems. consider the spectrum of lifeforms ranging from humans to bacteria. some animals in-between are probably conscious (monkeys, dogs, dolphins, elephants). but than we'd run into less clear cases (fish, lizard, cicada) or outright unfathomable cases (ant colonies, viruses, internet memes)
Answers.UserDisplayName: k.c. sayz 'k.c sayz'
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-11-23T01:53:29.123Z
Answers.Text: or more concretely, we don't quite know yet the function of consciousness
Answers.UserDisplayName: k.c. sayz 'k.c sayz'
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-11-17T16:39:11.637Z
Answers.LastActivityDate: 2017-11-17T16:39:11.637Z
Answers.UserDisplayName: k.c. sayz 'k.c sayz'
Answers.Body: <p>It may be helpful to think of consciousness, like intelligence, as a spectrum. The Stanford Encyclopedia of Philosophy, under the section &quot;Creature Consciousness&quot; (2.1) defines sentience as:</p>
  <blockquote>
  <p>Sentience. It may be conscious in the generic sense of simply being a sentient creature, one capable of sensing and responding to its world (Armstrong 1981). Being conscious in this sense may admit of degrees, and just what sort of sensory capacities are sufficient may not be sharply defined. Are fish conscious in the relevant respect? And what of shrimp or bees? <br><sub>Stanford Encyclopedia of Philosophy, <a href="http://Stanford%20Encyclopedia%20of%20Philosophy" rel="nofollow noreferrer">2.1 &quot;Creature Consciousness&quot;</a></sub></p>
  </blockquote>
  <p>It seems clear that AI possesses the most basic form of consciousness in terms of &quot;sensing and responding to its world&quot;.  I might liken this level of consciousness to that of microorganisms, able to interact with their environments but possessing none of the higher functions of humans, or even higher-order animals.</p>
  <p>We don't really understand the true nature of higher consciousness and human-level sentience, which doesn't necessarily mean that an automata with sufficient complexity couldn't achieve it.  But there is a deeper problem relating to <em>validation</em> (i.e. how would be know the system is truly self-aware, and not simulating self-awareness.  [See <a href="https://en.wikipedia.org/wiki/Chinese_room#Chinese_room_thought_experiment" rel="nofollow noreferrer">Searle's Chinese Room</a>, but also <a href="http://jmc.stanford.edu/articles/chinese.html" rel="nofollow noreferrer">McCarthy's Refutation] </a></p>
  <p>In his paper <em>Making Robots Conscious of their Mental
  States</em> McCarthy states:</p>
  <blockquote>
  <p>Conscious knowledge and other information is distinguished from
  unconscious information by being observable, and its observation results
  in conscious knowledge about it. We call this introspective knowledge.<br><br>
  A robot will need to use introspective knowledge in order to operate
  in the common sense world and accomplish the tasks humans will give
  it.<br><br>
  Many features of human consciousness will be wanted, some will
  not, and some abilities not possessed by humans have already been
  found feasible and useful in limited domains.<br><br>
  We give preliminary fragments of a logical language a robot can
  use to represent information about its own state of mind.<br><br>
  A robot will often have to conclude that it cannot decide a question
  on the basis of the information in memory and therefore must seek
  information externally.<br><br>
  Programs with much introspective consciousness do not yet exist.
  <br><sub><a href="http://jmc.stanford.edu/articles/consciousness/consciousness.pdf" rel="nofollow noreferrer">Making Robots Conscious of their Mental
  States, Abstract</a></sub></p>
  </blockquote>
  <p>This still seems to be the case, however, McCarthy seems hopeful about the &quot;<a href="https://en.wikipedia.org/wiki/Computational_theory_of_mind" rel="nofollow noreferrer">computationalist</a>&quot; approach:</p>
  <blockquote>
  <p>Thinking about consciousness with a view to designing it provides
  a new approach to some of the problems of consciousness studied by
  philosophers. One advantage is that it focusses on the aspects of
  consciousness important for intelligent behavior. If the advocates of
  qualia are right, it looks like robots won’t need them to exhibit any
  behavior exhibited by humans.<br><sub><a href="http://jmc.stanford.edu/articles/consciousness/consciousness.pdf" rel="nofollow noreferrer">ibid.</a></sub></p>
  </blockquote>
  <p>The continual increase in memory, processing and algorithmic sophistication may well yield <a href="https://en.wikipedia.org/wiki/Artificial_general_intelligence" rel="nofollow noreferrer">Artificial General Intelligence</a>.</p>
  <p>Even if this proves to be the case, I suspect the debate over artificial consciousness will rage on.</p>
  <hr />
  <p>See also: <a href="https://en.wikipedia.org/wiki/Artificial_consciousness" rel="nofollow noreferrer">Artificial Consciousness</a></p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-12-09T21:18:17.840Z
Answers.Text: Which question did you answer when writing this answer? I'm trying to understand what the OP was really asking. As you can see, I had changed the title and question of the post in an attempt to clarify the question, but, after having come back to this post, I still don't understand what the question really was, even after having read your answer.
Answers.UserDisplayName: nbro
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2017-11-16T19:21:19.730Z
Answers.LastActivityDate: 2021-01-31T14:15:41.023Z
Answers.LastEditDate: 2021-01-31T14:15:41.023Z
Answers.UserDisplayName: DukeZhou
Body: <p>With some knowledge of machine learning and deep learning, it seems very unlikely for AI to develop into the consciousness that we imagine.</p>
  <p>To me, consciousness requires a new framework that is very different from what we have today, as current forms of learning seem to be very 'shallow'.</p>
  <p>What are the current limitations to artificial consciousness and sentience? Also is there a difference between artificial consciousness and sentience?</p>
  
Tags: <artificial-consciousness><sentience>
Title: Current limitations to artificial consciousness
UserDisplayName: sma
ThreadText: # Current limitations to artificial consciousness
  
  (Asked by: username_0 on 2017-11-16)
  
  With some knowledge of machine learning and deep learning, it seems very unlikely for AI to develop into the consciousness that we imagine.
  
  To me, consciousness requires a new framework that is very different from what we have today, as current forms of learning seem to be very 'shallow'.
  
  What are the current limitations to artificial consciousness and sentience? Also is there a difference between artificial consciousness and sentience?
  
  **Tags:** artificial-consciousness, sentience
  
  
  ---
  
  ## 2 answers
  
  ### Answer by username_2 on 2017-11-16. Score: 5 | Accepted answer
  
  It may be helpful to think of consciousness, like intelligence, as a spectrum. The Stanford Encyclopedia of Philosophy, under the section "Creature Consciousness" (2.1) defines sentience as:
  
  > Sentience. It may be conscious in the generic sense of simply being a sentient creature, one capable of sensing and responding to its world (Armstrong 1981). Being conscious in this sense may admit of degrees, and just what sort of sensory capacities are sufficient may not be sharply defined. Are fish conscious in the relevant respect? And what of shrimp or bees?   
  > Stanford Encyclopedia of Philosophy, [2.1 "Creature Consciousness"](http://Stanford%20Encyclopedia%20of%20Philosophy)
  
  It seems clear that AI possesses the most basic form of consciousness in terms of "sensing and responding to its world". I might liken this level of consciousness to that of microorganisms, able to interact with their environments but possessing none of the higher functions of humans, or even higher-order animals.
  
  We don't really understand the true nature of higher consciousness and human-level sentience, which doesn't necessarily mean that an automata with sufficient complexity couldn't achieve it. But there is a deeper problem relating to *validation* (i.e. how would be know the system is truly self-aware, and not simulating self-awareness. [See [Searle's Chinese Room](https://en.wikipedia.org/wiki/Chinese_room#Chinese_room_thought_experiment), but also [McCarthy's Refutation]](http://jmc.stanford.edu/articles/chinese.html)
  
  In his paper *Making Robots Conscious of their Mental
  States* McCarthy states:
  
  > Conscious knowledge and other information is distinguished from
  > unconscious information by being observable, and its observation results
  > in conscious knowledge about it. We call this introspective knowledge.  
  >   
  > A robot will need to use introspective knowledge in order to operate
  > in the common sense world and accomplish the tasks humans will give
  > it.  
  >   
  > Many features of human consciousness will be wanted, some will
  > not, and some abilities not possessed by humans have already been
  > found feasible and useful in limited domains.  
  >   
  > We give preliminary fragments of a logical language a robot can
  > use to represent information about its own state of mind.  
  >   
  > A robot will often have to conclude that it cannot decide a question
  > on the basis of the information in memory and therefore must seek
  > information externally.  
  >   
  > Programs with much introspective consciousness do not yet exist.
  >   
  > [Making Robots Conscious of their Mental
  > States, Abstract](http://jmc.stanford.edu/articles/consciousness/consciousness.pdf)
  
  This still seems to be the case, however, McCarthy seems hopeful about the "[computationalist](https://en.wikipedia.org/wiki/Computational_theory_of_mind)" approach:
  
  > Thinking about consciousness with a view to designing it provides
  > a new approach to some of the problems of consciousness studied by
  > philosophers. One advantage is that it focusses on the aspects of
  > consciousness important for intelligent behavior. If the advocates of
  > qualia are right, it looks like robots won’t need them to exhibit any
  > behavior exhibited by humans.  
  > [ibid.](http://jmc.stanford.edu/articles/consciousness/consciousness.pdf)
  
  The continual increase in memory, processing and algorithmic sophistication may well yield [Artificial General Intelligence](https://en.wikipedia.org/wiki/Artificial_general_intelligence).
  
  Even if this proves to be the case, I suspect the debate over artificial consciousness will rage on.
  
  ---
  
  See also: [Artificial Consciousness](https://en.wikipedia.org/wiki/Artificial_consciousness)
  
  > **Comments:**
  > **username_3**: Which question did you answer when writing this answer? I'm trying to understand what the OP was really asking. As you can see, I had changed the title and question of the post in an attempt to clarify the question, but, after having come back to this post, I still don't understand what the question really was, even after having read your answer.  
  
  ---
  
  ### Answer by username_1 on 2017-11-17. Score: 2
  
  By the cognitive science / psychology literature, we don't have a theory of consciousness, or a measure of sentience. By its very nature, "things" like those can only be understood with respect to ones own subjective experience (as in you can only understand consciousness by comparing it to your own conscious experience).
  
  So no, even if we have a device that perfectly replicates the function of consciousness or sentience, we'd still have a hard time saying that it conclusively is indeed consciousness.
  
  > **Comments:**
  > **username_2**: It will be interesting to see the types of tests that come out of the cognitive science field, should such systems emerge.  I suspect the question will remain in the area of metaphysics for a good long time, regardless.  The better sci-fi authors/philosophers have grappled with this question, Phillip Dick in particular.  In some ways, you might cast his view in context of the "[Duck Test](https://en.wikipedia.org/wiki/Duck_test)". *(I wouldn't be surprised if there is strong sentiment for the idea that "if it talks like a person, and acts like a person, then it's probably a person";)*  
  > **username_1**: it's also quite hard to agree even on living systems. consider the spectrum of lifeforms ranging from humans to bacteria. some animals in-between are probably conscious (monkeys, dogs, dolphins, elephants). but than we'd run into less clear cases (fish, lizard, cicada) or outright unfathomable cases (ant colonies, viruses, internet memes)  
  > **username_1**: or more concretely, we don't quite know yet the function of consciousness  
  
  ---
  
  