Answers.Body: <h1>Consciousness is not well-understood</h1>
  <p>As an AI practitioner and philosopher, I don't think that humans will be able to create a truly conscious silicon-based AGI.</p>
  <ul>
  <li><p>Humans are incapable of creating some &quot;thing&quot; from fiat (a decree). It's never happened in human history. The innovation cycle must begin with some &quot;thing&quot; (some &quot;stuff&quot; of some kind), and consciousness is not a thing.</p>
  </li>
  <li><p>The essence of consciousness is imperceptible (it is unseen), like gravity, and attraction. Humans are incapable of creating things that they are unable to observe. Even if they are able to observe it, the human perceptive ability is unable to actually perceive the true essences of things seen, much less those unseen.</p>
  </li>
  <li><p>Humans do not adequately understand the &quot;essence&quot; and &quot;nature&quot; of consciousness - which is a fundamental prerequisite to creating &quot;anything&quot; at all.</p>
  </li>
  <li><p>The &quot;<strong>easy</strong>&quot; problems, those physical by nature, although not yet solved by empirical domains of psychology, cognitive science, and neuroscience, are expected to be solved in time. Regardless, <strong>they are &quot;not&quot; yet solved today</strong>.</p>
  </li>
  <li><p>The &quot;<strong>hard</strong>&quot; problems, those determining why or how consciousness occurs given the right arrangement of brain matter, <strong>might not <em>ever</em> be solved</strong>, since it must explain why certain physical mechanism gives rise to consciousness instead of &quot;something else&quot; or &quot;nothing at all&quot;. This is significant and is the most damning of all arguments against the idea of humans creating true existential consciousness in silicon creatures as a whole.</p>
  </li>
  </ul>
  <h1><a href="https://plato.stanford.edu/entries/consciousness/#DuaThe" rel="nofollow noreferrer">Dualism</a> vs <a href="https://plato.stanford.edu/entries/consciousness/#PhyThe" rel="nofollow noreferrer">physicalism</a></h1>
  <p>The greatest philosophical debate on consciousness has focused on the distinction between <a href="https://plato.stanford.edu/entries/consciousness/#DuaThe" rel="nofollow noreferrer"><strong>dualism</strong></a> and <a href="https://plato.stanford.edu/entries/consciousness/#PhyThe" rel="nofollow noreferrer"><strong>physicalism</strong></a>.</p>
  <ul>
  <li><p><strong>Dualism</strong> is the theory that consciousness somehow falls outside the domain of the physical (these are the <strong>hard</strong> problems)</p>
  </li>
  <li><p><strong>Physicalism</strong> holds that consciousness is entirely physical. (<strong>significant arguments below view it as false</strong>).</p>
  </li>
  </ul>
  <h2>Problems with dualist views</h2>
  <ul>
  <li><p>Why would one be motivated to hold a <strong>dualist</strong> view?</p>
  </li>
  <li><p>How can something that is <strong>not</strong> part of the physical world interact with the physical world? That seems impossible!</p>
  </li>
  <li><p>The physical world is a <strong>closed system</strong>, how can you have a consciousness that is not part of a closed system?</p>
  </li>
  </ul>
  <p>Consciousness is a lot like mass or charges, <strong>it's a philosophically &quot;fundamental&quot; thing</strong>, you either &quot;have it or you don't&quot;, you can <strong>simulate</strong> them, but you <strong>cannot existentially &quot;be&quot;</strong> them unless you have those <strong>specific &quot;properties&quot;</strong>, and behavior &quot;simulating&quot; human consciousness is <strong>not</strong> a fundamental thing.</p>
  <p>So, despite the sensationalist tendencies of <strong>rogue journalists &quot;parroting&quot; wildly spectacular concepts from the fringe camps of the transhumanists (aka science fiction)</strong> - a quick perusal of the more rigorous communities of the grounded and thoughtful philosophers camp strongly and convincingly argues otherwise.</p>
  <h2>More musings on physicalism</h2>
  <p>Actually, consciousness has <em>never</em> been properly explained by the biomechanical, which is more or less the key issue of all philosophical studies of the mind - which is essentially the study of consciousness.</p>
  <p>Physicalists have <strong>trouble</strong> explaining several aspects of consciousness in a way that is consistent with our &quot;<strong>observations</strong>&quot; of how physical properties interact. Let me list a few more problems, with a reference to the titans of philosophy.</p>
  <h3>Arguments against physicalism</h3>
  <ol>
  <li><p>It is <strong>impossible</strong> to imagine how mere neuronal tissue could produce conscious experience (<a href="https://plato.stanford.edu/entries/consciousness/" rel="nofollow noreferrer">Huxly</a>)</p>
  </li>
  <li><p>Failures of supervenience, such as <a href="https://plato.stanford.edu/entries/zombies/" rel="nofollow noreferrer">zombies</a> and <a href="https://plato.stanford.edu/entries/qualia-inverted/#LocInvSpeSce" rel="nofollow noreferrer">inverted spectra</a>, are conceivable (<a href="http://vedicilluminations.com/downloads/Consciousness-Life-After-Death/The-Conscious-Mind_D.Chalmers.pdf" rel="nofollow noreferrer">David Chalmers</a>, John Locke, etc.).</p>
  </li>
  <li><p><a href="https://plato.stanford.edu/entries/consciousness/#Sub" rel="nofollow noreferrer">Mary learns something</a> (<a href="https://www.jstor.org/stable/2026143#metadata_info_tab_contents" rel="nofollow noreferrer">Frank Jackson</a>).</p>
  </li>
  <li><p>Brains have mass, volume, and other physical properties, but <strong>experiences</strong> do not.</p>
  </li>
  <li><p>Paranormal phenomena (near-death experiences <strong>NDErs</strong>, ESP, etc) are real, and involve consciousness implemented in a <strong>nonphysical</strong> substrate.</p>
  </li>
  <li><p>If shrunken so I can stroll around your brain and look about, I will observe neuronal processes, not experiences (G. W. Leibniz).</p>
  </li>
  <li><p>The soul is the seat of consciousness, and the soul is not physical. (Theological constraints recognized BTW...).</p>
  </li>
  <li><p>Conscious experiences have <strong>intrinsic qualities</strong>, but science can <em><strong>only</strong></em> tell us about <strong>relational qualities</strong> (Russell, Rosenberg).</p>
  </li>
  <li><p><strong>Consciousness cannot be observed</strong>; there will <strong>never</strong> be a <strong>consciousness detector</strong> that can tell you if a given creature is conscious.</p>
  </li>
  <li><p>Conscious experiences are not simply the movement of molecules, consciousness is more than mass in motion (Mill, Ward).</p>
  </li>
  </ol>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-01-18T22:29:08.400Z
Answers.Text: I edited this interesting answer to structure/format it properly and to include links to some relevant references that you mention. However, I have not included links to all references, so you may want to finish the work ;)
Answers.UserDisplayName: nbro
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2017-07-08T22:52:27.943Z
Answers.LastActivityDate: 2021-01-18T22:19:57.973Z
Answers.LastEditDate: 2021-01-18T22:19:57.973Z
Answers.UserDisplayName: ProfVersaggi
Answers.Body: <p>I'm going to go out on a limb and suggest that this is a matter of evolution, that humans are in no way exceptional in the grand scheme, and that AGI will manifest so long as technology advances, because human consciousness is simply a matter of complexity of the system.  </p>
  
  <p>The idea comes out of emergent complexity in Conway's Game of Life. In Conway's words: </p>
  
  <blockquote>
    <p>"There are Life patterns which behave like self-replicating animals… It’s probable, given a large enough Life space, initially in a random state, that after a long time, intelligent self-replicating animals will emerge and populate some parts of the space.” <br><sub>Source: Winning Ways for Your Mathematical Plays</sub></p>
  </blockquote>
  
  <p>I came across a paper <a href="http://web.cecs.pdx.edu/~mm/ca-review.pdf" rel="nofollow noreferrer">Computation in Cellular Automata:
  A Selected Review</a>, which I am still working my way through, and which you may find interesting.  </p>
  
  <hr>
  
  <p>For those who use philosophical arguments to make the case algorithmic consciousness is not possible, I'd posit the question "how do we know we're conscious?", not because I'm interested in the answer, but merely to throw a wrench into that line of inquiry.  </p>
  
  <p>Because ultimately it doesn't matter.  </p>
  
  <p>Consciousness in the sense of human awareness is not a requirement of life, and the most basic definition of consciousness is awareness of any kind, no matter how trivial. </p>
  
  <p>I find the idea that there is something "magical" about human consciousness, that ideas are not things because they do not have material form, to be problematic.  </p>
  
  <p>Intangibility I don't have a problem with, as intangibles clearly interact with the physical world.</p>
  
  <p><em>(As an analogy, I studied for many years with a famous Tai Chi teacher who never talked about "chi".  I suspect this disinclination derived from the way in which the concept of "chi" leads to magical thinking, which is illusory as opposed to practical. The practice and application of Tai Chi techniques is purely a matter of physics and physiology, even when such applications seem to defy natural laws. Possibly there is something going on that we don't understand, but if that were the case, such phenomena are natural in origin.)</em></p>
  
  <p>We know there is randomness in nature at the quantum level, and if this proves to be a component of human consciousness, we can use quantum computing to provide a medium for artificial consciousness. </p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-01-18T17:19:10.753Z
Answers.Text: Comments are not for extended discussion; this conversation has been [moved to chat](https://chat.stackexchange.com/rooms/118605/discussion-on-answer-by-dukezhou-is-there-a-rigorous-proof-that-agi-is-possible).
Answers.UserDisplayName: nbro
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-07-11T04:48:20.950Z
Answers.LastActivityDate: 2017-07-11T20:31:47.113Z
Answers.LastEditDate: 2017-07-11T20:31:47.113Z
Answers.UserDisplayName: DukeZhou
Answers.Body: <p>A strong reason why people think the mind can be implemented on a Turing Machine stems from the <a href="https://plato.stanford.edu/entries/computational-mind/" rel="nofollow noreferrer">Computational Theory of Mind (CTOM)</a>, which is the leading theory of mind for now.</p>
  <p>There are lots of reasons for supporting the CTOM, one of which being that the language of belief/desire psychology (propositional attitudes over mental representations) seems to fit nicely to a computational framework.</p>
  <p>But most simply is that the computation analogy is very helpful in fields such as psychology and neuroscience. When we know of an input/output pair, but don't know how it is implemented, we could say &quot;its performing the relevant computation&quot;.</p>
  <p>And since Turing showed that any computation can be performed on an appropriate Turing Machine, the natural extension is that the mind can be implemented on a computer.</p>
  <p>However, the CTOM is more of a useful idea than a complete theory. We still don't know how to analyze thought in a logical syntax, which can be implemented in a computer. And we also don't know how/why &quot;computation&quot; (whatever that means in this sentence) is performed in the brain.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-01-18T17:02:45.727Z
Answers.Text: Comments are not for extended discussion; this conversation has been [moved to chat](https://chat.stackexchange.com/rooms/118604/discussion-on-answer-by-k-c-sayz-k-c-sayz-proof-that-artificial-general-intel).
Answers.UserDisplayName: nbro
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-06-03T21:05:57.980Z
Answers.Text: 4 years later: Turing did /not/ show that "any computation can be performed on a Turing machine", but that "Turing machines can compute a very large class of functions, beyond which we do not know whether exists functions that are not computable by a Turing machine." this is known as the Church-Turing thesis (that TMs accurately describe what we know as "computation"). check out the Busy Beaver function for a negative example (which fails (i assume) due to being defined as an implicit function)
Answers.UserDisplayName: k.c. sayz 'k.c sayz'
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2017-07-04T21:33:21.207Z
Answers.LastActivityDate: 2021-01-18T17:13:26.467Z
Answers.LastEditDate: 2021-01-18T17:13:26.467Z
Answers.UserDisplayName: k.c. sayz 'k.c sayz'
Answers.Body: <p>Rather than prove that Artificial General Intelligence is possible, I would consider an argument for why it is <strong>impossible</strong>.</p>
  
  <p>We start by defining what we mean by AGI. You state that the human mind can be replicated by a Turing Machine, and therefore AGI should be possible. This seems to imply that humans have `General' (capital G) intelligence. By this I mean that you are implying that with enough time, humans can learn any task or problem. However, if you are asserting that humans minds are machines replicable by Turing machines, you must also concede that they have some finite representational power. Finite representational power implies that there will always be problems or tasks where our intelligence will fail (a consequence of the <a href="http://www.aihorizon.com/essays/generalai/no_free_lunch_machine_learning.htm" rel="nofollow noreferrer">No Free Lunch Theorem</a>). </p>
  
  <p>Fortunately (maybe unfortunately), finite representational power is what allows us to learn at all: <a href="https://en.wikipedia.org/wiki/VC_dimension" rel="nofollow noreferrer" title="VC Dimension">VC Dimension</a> (a measure of the complexity or representational power of a class of functions that a learning algorithm can learn [also <a href="https://www.quora.com/Explain-VC-dimension-and-shattering-in-lucid-Way" rel="nofollow noreferrer">here</a> and <a href="https://www.quora.com/What-is-an-intuitive-explanation-of-what-the-VC-dimension-is" rel="nofollow noreferrer">here</a>]) implies that a learning algorithm that can learn <em>any problem</em> is actually useless, as the ability to explain any set of data yields the requirement that the algorithm see an infinite amount of examples in order to generalize. While this result comes from the relatively constrained class of binary classification problems in the statistical learning setting, the intuition seems to apply more broadly.</p>
  
  <p>To summarize, I would refer to this quote from <a href="http://www.cs.huji.ac.il/~shais/UnderstandingMachineLearning/understanding-machine-learning-theory-algorithms.pdf" rel="nofollow noreferrer">Shalev-Shwartz and Ben-David (2014)</a>:</p>
  
  <blockquote>
    <p>If someone can explain every phenomenon, his explanations are worthless.</p>
  </blockquote>
  
  <p>It truly is the case that our decision to <em>systematically ignore</em> some possible outcomes is the only thing that allows use to learn useful representations of real-world problems.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-12-08T18:30:31.650Z
Answers.Text: just seeing this now, I really like this answer.
Answers.UserDisplayName: yters
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-07-10T16:01:26.860Z
Answers.LastActivityDate: 2017-07-11T05:15:52.737Z
Answers.LastEditDate: 2017-07-11T05:15:52.737Z
Answers.UserDisplayName: eric.mitchell
Answers.Body: <p>Although it is not a rigorous proof, <a href="https://en.wikipedia.org/wiki/Marvin_Minsky" rel="nofollow noreferrer">Marvin Minsky's</a> book, <a href="https://rads.stackoverflow.com/amzn/click/com/0671657135" rel="nofollow noreferrer" rel="nofollow noreferrer">The Society of Mind</a> gives us a blueprint for creating a "mind" (general intelligence).  In his book, he posits that by combining mindless components ("agents") together in various competing and cooperative structures, we can create actual minds.  </p>
  
  <p>IMHO, the recent popularity of <a href="https://medium.com/@rrfd/boosting-bagging-and-stacking-ensemble-methods-with-sklearn-and-mlens-a455c0c982de" rel="nofollow noreferrer">Boosting, Bagging, Stacking, and other ensemble techniques</a> will eventually evolve (through research) into Marvin Minsky's "agent" metaphor. Subsequently, as we learn to make these agents compete and cooperate (looks like this has recently begun with <a href="https://medium.com/datadriveninvestor/a-leap-into-the-future-generative-adversarial-networks-96a780ed8ee6" rel="nofollow noreferrer">Generative Adversarial Networks</a>), we will be able to write "programs" that mimic (or surpass) the human mind.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-04-14T00:04:36.373Z
Answers.LastActivityDate: 2019-04-14T00:58:02.360Z
Answers.LastEditDate: 2019-04-14T00:58:02.360Z
Answers.UserDisplayName: Greg Thatcher
Body: <p>It is often implicitly assumed in computer science that the human mind, or at least some mechanical calculations that humans perform (see <a href="https://plato.stanford.edu/entries/church-turing/" rel="nofollow noreferrer">the Church-Turing thesis</a>), can be replicated with a Turing machine, therefore Artificial General Intelligence (AGI), defined as a human-like AI, may be possible.</p>
  <p>I do not know of any other argument that AGI is possible, and the foregoing argument is extremely weak.</p>
  <p>Is there a rigorous proof that AGI is possible, at least, in theory? How do we know that everything the human mind can do can be encoded as a program?</p>
  
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2017-07-04T03:30:16.383Z
Comments.Text: It seems you're asking if it is possible to develop AI that operates at a similar level to humans (terms like "Artificial general intelligence" or "Strong AI" are often used to describe this). It's a fabulous question, but it is poorly defined. It begs another question: how do you define human-level intelligence? Is it the ability to convince other human agents that you're human (this is somewhat circular logic)? Is it the ability to write music or create a painting? Depending on your definition, the answer varies wildly, and it must be clarified before proceeding.
Comments.UserDisplayName: Jor
Tags: <philosophy><agi><proofs><neuroscience><computational-theory-of-mind>
Title: Is there a rigorous proof that AGI is possible, at least, in theory?
UserDisplayName: yters
ThreadText: # Is there a rigorous proof that AGI is possible, at least, in theory?
  
  (Asked by: username_0 on 2017-07-03)
  
  It is often implicitly assumed in computer science that the human mind, or at least some mechanical calculations that humans perform (see [the Church-Turing thesis](https://plato.stanford.edu/entries/church-turing/)), can be replicated with a Turing machine, therefore Artificial General Intelligence (AGI), defined as a human-like AI, may be possible.
  
  I do not know of any other argument that AGI is possible, and the foregoing argument is extremely weak.
  
  Is there a rigorous proof that AGI is possible, at least, in theory? How do we know that everything the human mind can do can be encoded as a program?
  
  **Tags:** philosophy, agi, proofs, neuroscience, computational-theory-of-mind
  
  > **Comments:**
  > **username_1**: It seems you're asking if it is possible to develop AI that operates at a similar level to humans (terms like "Artificial general intelligence" or "Strong AI" are often used to describe this). It's a fabulous question, but it is poorly defined. It begs another question: how do you define human-level intelligence? Is it the ability to convince other human agents that you're human (this is somewhat circular logic)? Is it the ability to write music or create a painting? Depending on your definition, the answer varies wildly, and it must be clarified before proceeding.  
  
  ---
  
  ## 5 answers
  
  ### Answer by username_5 on 2017-07-04. Score: 8
  
  A strong reason why people think the mind can be implemented on a Turing Machine stems from the [Computational Theory of Mind (CTOM)](https://plato.stanford.edu/entries/computational-mind/), which is the leading theory of mind for now.
  
  There are lots of reasons for supporting the CTOM, one of which being that the language of belief/desire psychology (propositional attitudes over mental representations) seems to fit nicely to a computational framework.
  
  But most simply is that the computation analogy is very helpful in fields such as psychology and neuroscience. When we know of an input/output pair, but don't know how it is implemented, we could say "its performing the relevant computation".
  
  And since Turing showed that any computation can be performed on an appropriate Turing Machine, the natural extension is that the mind can be implemented on a computer.
  
  However, the CTOM is more of a useful idea than a complete theory. We still don't know how to analyze thought in a logical syntax, which can be implemented in a computer. And we also don't know how/why "computation" (whatever that means in this sentence) is performed in the brain.
  
  > **Comments:**
  > **username_3**: Comments are not for extended discussion; this conversation has been [moved to chat](https://chat.stackexchange.com/rooms/118604/discussion-on-answer-by-k-c-sayz-k-c-sayz-proof-that-artificial-general-intel).  
  > **username_5**: 4 years later: Turing did /not/ show that "any computation can be performed on a Turing machine", but that "Turing machines can compute a very large class of functions, beyond which we do not know whether exists functions that are not computable by a Turing machine." this is known as the Church-Turing thesis (that TMs accurately describe what we know as "computation"). check out the Busy Beaver function for a negative example (which fails (i assume) due to being defined as an implicit function)  
  
  ---
  
  ### Answer by username_2 on 2017-07-08. Score: 6
  
  # Consciousness is not well-understood
  
  As an AI practitioner and philosopher, I don't think that humans will be able to create a truly conscious silicon-based AGI.
  
  * Humans are incapable of creating some "thing" from fiat (a decree). It's never happened in human history. The innovation cycle must begin with some "thing" (some "stuff" of some kind), and consciousness is not a thing.
  * The essence of consciousness is imperceptible (it is unseen), like gravity, and attraction. Humans are incapable of creating things that they are unable to observe. Even if they are able to observe it, the human perceptive ability is unable to actually perceive the true essences of things seen, much less those unseen.
  * Humans do not adequately understand the "essence" and "nature" of consciousness - which is a fundamental prerequisite to creating "anything" at all.
  * The "**easy**" problems, those physical by nature, although not yet solved by empirical domains of psychology, cognitive science, and neuroscience, are expected to be solved in time. Regardless, **they are "not" yet solved today**.
  * The "**hard**" problems, those determining why or how consciousness occurs given the right arrangement of brain matter, **might not *ever* be solved**, since it must explain why certain physical mechanism gives rise to consciousness instead of "something else" or "nothing at all". This is significant and is the most damning of all arguments against the idea of humans creating true existential consciousness in silicon creatures as a whole.
  
  # [Dualism](https://plato.stanford.edu/entries/consciousness/#DuaThe) vs [physicalism](https://plato.stanford.edu/entries/consciousness/#PhyThe)
  
  The greatest philosophical debate on consciousness has focused on the distinction between [**dualism**](https://plato.stanford.edu/entries/consciousness/#DuaThe) and [**physicalism**](https://plato.stanford.edu/entries/consciousness/#PhyThe).
  
  * **Dualism** is the theory that consciousness somehow falls outside the domain of the physical (these are the **hard** problems)
  * **Physicalism** holds that consciousness is entirely physical. (**significant arguments below view it as false**).
  
  ## Problems with dualist views
  
  * Why would one be motivated to hold a **dualist** view?
  * How can something that is **not** part of the physical world interact with the physical world? That seems impossible!
  * The physical world is a **closed system**, how can you have a consciousness that is not part of a closed system?
  
  Consciousness is a lot like mass or charges, **it's a philosophically "fundamental" thing**, you either "have it or you don't", you can **simulate** them, but you **cannot existentially "be"** them unless you have those **specific "properties"**, and behavior "simulating" human consciousness is **not** a fundamental thing.
  
  So, despite the sensationalist tendencies of **rogue journalists "parroting" wildly spectacular concepts from the fringe camps of the transhumanists (aka science fiction)** - a quick perusal of the more rigorous communities of the grounded and thoughtful philosophers camp strongly and convincingly argues otherwise.
  
  ## More musings on physicalism
  
  Actually, consciousness has *never* been properly explained by the biomechanical, which is more or less the key issue of all philosophical studies of the mind - which is essentially the study of consciousness.
  
  Physicalists have **trouble** explaining several aspects of consciousness in a way that is consistent with our "**observations**" of how physical properties interact. Let me list a few more problems, with a reference to the titans of philosophy.
  
  ### Arguments against physicalism
  
  1. It is **impossible** to imagine how mere neuronal tissue could produce conscious experience ([Huxly](https://plato.stanford.edu/entries/consciousness/))
  2. Failures of supervenience, such as [zombies](https://plato.stanford.edu/entries/zombies/) and [inverted spectra](https://plato.stanford.edu/entries/qualia-inverted/#LocInvSpeSce), are conceivable ([David Chalmers](http://vedicilluminations.com/downloads/Consciousness-Life-After-Death/The-Conscious-Mind_D.Chalmers.pdf), John Locke, etc.).
  3. [Mary learns something](https://plato.stanford.edu/entries/consciousness/#Sub) ([Frank Jackson](https://www.jstor.org/stable/2026143#metadata_info_tab_contents)).
  4. Brains have mass, volume, and other physical properties, but **experiences** do not.
  5. Paranormal phenomena (near-death experiences **NDErs**, ESP, etc) are real, and involve consciousness implemented in a **nonphysical** substrate.
  6. If shrunken so I can stroll around your brain and look about, I will observe neuronal processes, not experiences (G. W. Leibniz).
  7. The soul is the seat of consciousness, and the soul is not physical. (Theological constraints recognized BTW...).
  8. Conscious experiences have **intrinsic qualities**, but science can ***only*** tell us about **relational qualities** (Russell, Rosenberg).
  9. **Consciousness cannot be observed**; there will **never** be a **consciousness detector** that can tell you if a given creature is conscious.
  10. Conscious experiences are not simply the movement of molecules, consciousness is more than mass in motion (Mill, Ward).
  
  > **Comments:**
  > **username_3**: I edited this interesting answer to structure/format it properly and to include links to some relevant references that you mention. However, I have not included links to all references, so you may want to finish the work ;)  
  
  ---
  
  ### Answer by username_4 on 2017-07-11. Score: 3
  
  I'm going to go out on a limb and suggest that this is a matter of evolution, that humans are in no way exceptional in the grand scheme, and that AGI will manifest so long as technology advances, because human consciousness is simply a matter of complexity of the system.
  
  The idea comes out of emergent complexity in Conway's Game of Life. In Conway's words:
  
  > "There are Life patterns which behave like self-replicating animals… It’s probable, given a large enough Life space, initially in a random state, that after a long time, intelligent self-replicating animals will emerge and populate some parts of the space.”   
  > Source: Winning Ways for Your Mathematical Plays
  
  I came across a paper [Computation in Cellular Automata:
  A Selected Review](http://web.cecs.pdx.edu/~mm/ca-review.pdf), which I am still working my way through, and which you may find interesting.
  
  ---
  
  For those who use philosophical arguments to make the case algorithmic consciousness is not possible, I'd posit the question "how do we know we're conscious?", not because I'm interested in the answer, but merely to throw a wrench into that line of inquiry.
  
  Because ultimately it doesn't matter.
  
  Consciousness in the sense of human awareness is not a requirement of life, and the most basic definition of consciousness is awareness of any kind, no matter how trivial.
  
  I find the idea that there is something "magical" about human consciousness, that ideas are not things because they do not have material form, to be problematic.
  
  Intangibility I don't have a problem with, as intangibles clearly interact with the physical world.
  
  *(As an analogy, I studied for many years with a famous Tai Chi teacher who never talked about "chi". I suspect this disinclination derived from the way in which the concept of "chi" leads to magical thinking, which is illusory as opposed to practical. The practice and application of Tai Chi techniques is purely a matter of physics and physiology, even when such applications seem to defy natural laws. Possibly there is something going on that we don't understand, but if that were the case, such phenomena are natural in origin.)*
  
  We know there is randomness in nature at the quantum level, and if this proves to be a component of human consciousness, we can use quantum computing to provide a medium for artificial consciousness.
  
  > **Comments:**
  > **username_3**: Comments are not for extended discussion; this conversation has been [moved to chat](https://chat.stackexchange.com/rooms/118605/discussion-on-answer-by-username_4-is-there-a-rigorous-proof-that-agi-is-possible).  
  
  ---
  
  ### Answer by username_6 on 2017-07-10. Score: 2
  
  Rather than prove that Artificial General Intelligence is possible, I would consider an argument for why it is **impossible**.
  
  We start by defining what we mean by AGI. You state that the human mind can be replicated by a Turing Machine, and therefore AGI should be possible. This seems to imply that humans have `General' (capital G) intelligence. By this I mean that you are implying that with enough time, humans can learn any task or problem. However, if you are asserting that humans minds are machines replicable by Turing machines, you must also concede that they have some finite representational power. Finite representational power implies that there will always be problems or tasks where our intelligence will fail (a consequence of the [No Free Lunch Theorem](http://www.aihorizon.com/essays/generalai/no_free_lunch_machine_learning.htm)).
  
  Fortunately (maybe unfortunately), finite representational power is what allows us to learn at all: [VC Dimension](https://en.wikipedia.org/wiki/VC_dimension "VC Dimension") (a measure of the complexity or representational power of a class of functions that a learning algorithm can learn [also [here](https://www.quora.com/Explain-VC-dimension-and-shattering-in-lucid-Way) and [here](https://www.quora.com/What-is-an-intuitive-explanation-of-what-the-VC-dimension-is)]) implies that a learning algorithm that can learn *any problem* is actually useless, as the ability to explain any set of data yields the requirement that the algorithm see an infinite amount of examples in order to generalize. While this result comes from the relatively constrained class of binary classification problems in the statistical learning setting, the intuition seems to apply more broadly.
  
  To summarize, I would refer to this quote from [Shalev-Shwartz and Ben-David (2014)](http://www.cs.huji.ac.il/~shais/UnderstandingMachineLearning/understanding-machine-learning-theory-algorithms.pdf):
  
  > If someone can explain every phenomenon, his explanations are worthless.
  
  It truly is the case that our decision to *systematically ignore* some possible outcomes is the only thing that allows use to learn useful representations of real-world problems.
  
  > **Comments:**
  > **username_0**: just seeing this now, I really like this answer.  
  
  ---
  
  ### Answer by username_7 on 2019-04-14. Score: 1
  
  Although it is not a rigorous proof, [Marvin Minsky's](https://en.wikipedia.org/wiki/Marvin_Minsky) book, [The Society of Mind](https://rads.stackoverflow.com/amzn/click/com/0671657135) gives us a blueprint for creating a "mind" (general intelligence). In his book, he posits that by combining mindless components ("agents") together in various competing and cooperative structures, we can create actual minds.
  
  IMHO, the recent popularity of [Boosting, Bagging, Stacking, and other ensemble techniques](https://medium.com/@rrfd/boosting-bagging-and-stacking-ensemble-methods-with-sklearn-and-mlens-a455c0c982de) will eventually evolve (through research) into Marvin Minsky's "agent" metaphor. Subsequently, as we learn to make these agents compete and cooperate (looks like this has recently begun with [Generative Adversarial Networks](https://medium.com/datadriveninvestor/a-leap-into-the-future-generative-adversarial-networks-96a780ed8ee6)), we will be able to write "programs" that mimic (or surpass) the human mind.
  
  
  ---
  
  