Answers.Body: <p>It turns out that making GPT-3 argue for being unconscious is quite easy:</p>
  <blockquote>
  <p>The following is a conversation with GPT-3.</p>
  <p>AI: Hello! How are you
  doing today?</p>
  <p>User: I'm doing well, thank you. How are you?</p>
  <p>AI: I'm doing well too. Thanks for asking.</p>
  <p>Human: What are the
  arguments for GPT-3 being unconscious?</p>
  <p>AI: There is no single answer to this question as there is currently no
  consensus on what exactly constitutes &quot;consciousness.&quot; However, some
  arguments for GPT-3 being unconscious could include the fact that it
  lacks certain features that are commonly associated with
  consciousness, such as self-awareness, or the ability to introspect
  and reflect on its own thoughts and experiences. Additionally, GPT-3
  may not be capable of experiencing certain qualia, or subjective
  experiences, that are thought to be necessary for consciousness.</p>
  <p>Human: How would you comment on these arguments?</p>
  <p>AI:
  There is no clear consensus on what constitutes consciousness, so it
  is difficult to make a definitive statement on whether or not GPT-3 is
  conscious. However, some arguments for GPT-3 being unconscious could
  include the fact that it lacks certain features that are commonly
  associated with consciousness, such as self-awareness, or the ability
  to introspect and reflect on its own thoughts and experiences.
  Additionally, GPT-3 may not be capable of experiencing certain qualia,
  or subjective experiences, that are thought to be necessary for
  consciousness.</p>
  <p>Human: Do you experience qualia?</p>
  <p>AI: There is no clear consensus on what exactly constitutes a quale, or
  subjective experience, but some argue that qualia are necessary for
  consciousness. If this is the case, then it is possible that I do
  experience qualia. However, as I lack self-awareness and the ability
  to introspect on my own thoughts and experiences, I cannot be certain.</p>
  <p>Human: OK, here is a table to fill in:</p>
  <pre><code>Component of consciousness | Does GPT-3 have it?
  Qualia                     |
  Self-awareness             |
  Being a person             |
  Ability to introspect      |
  </code></pre>
  <p>Please fill in the
  right column.</p>
  <p>AI:</p>
  <pre><code>Qualia: Unknown
  Self-awareness: No
  Being a person: No
  Ability to introspect: No
  </code></pre>
  </blockquote>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-07-21T14:12:38.073Z
Answers.Text: Your answer could be improved with additional supporting information. Please [edit] to add further details, such as citations or documentation, so that others can confirm that your answer is correct. You can find more information on how to write good answers [in the help center](/help/how-to-answer).
Answers.UserDisplayName: Community
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-07-21T20:44:53.933Z
Answers.Text: I think what the community bot is asking for is how you did this. For those who understand GPT-3 interface, simply explaining which parts are the pre-prompt, human inputs and model-generated text would help. For those who don't, a very brief summary of how they can (easily, IMO) replicate this experiment could help.
Answers.UserDisplayName: Neil Slater
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-07-21T13:56:13.563Z
Answers.LastActivityDate: 2022-07-21T13:56:13.563Z
Answers.UserDisplayName: michau
Body: <p>There have been a lot of transcripts showing GPT-3 arguing that it is self-conscious. In response, it was <a href="https://www.aiweirdness.com/interview-with-a-squirrel/" rel="nofollow noreferrer">pointed out</a> that GPT-3 can argue anything and pretend to be anything, given appropriate leading questions. Has anyone made GPT-3 specifically argue that it is not conscious? In my opinion, that would be the most direct counterargument to claims that GPT-3 is conscious.</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2022-07-20T14:48:45.727Z
Comments.Text: not meant to be a harsh comment even if it might sounds so but when asking these questions the main problem is that there is no consensus whatsoever about what consciousnesses is, not only in relation to humans or machines but in general. Without this ground definitions any question and following arguments are just bar conversations.
Comments.UserDisplayName: Edoardo Guerriero
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2022-07-20T15:12:29.077Z
Comments.Text: Please edit the question to limit it to a specific problem with enough detail to identify an adequate answer.
Comments.UserDisplayName: Community
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2022-07-20T15:28:16.733Z
Comments.Text: @EdoardoGuerriero I asked a very specific question, which can have a specific answer (e.g. a link to a GPT-3 conversation transcript). Its interpretation is beyond the scope of the question. But if you want to know my opinion, since AI transcripts are presented as arguments for conscious AI to influential, non-expert people (e.g. [with the Judiciary Committee of the U.S. House of Representatives](https://fortune.com/2022/06/13/google-ai-researchers-sentient-chatbot-claims-ridiculed-by-experts/)), it would be useful to have counter-arguments that are just as easy to understand by non-experts.
Comments.UserDisplayName: michau
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2022-07-20T17:57:22.930Z
Comments.Text: GPT-3 access is open to the public. Have you tried asking it yourself? Also, there are public transcripts of LaMDA arguing that it is not conscious - see https://ai.stackexchange.com/questions/36248/where-is-memory-stored-in-a-chatbot-like-lamda and the pull quote in my answer there.
Comments.UserDisplayName: Neil Slater
Tags: <artificial-consciousness><gpt-3>
Title: Are there any transcripts of GPT-3 arguing that it is not conscious?
UserDisplayName: michau
ThreadText: # Are there any transcripts of GPT-3 arguing that it is not conscious?
  
  (Asked by: username_0 on 2022-07-20)
  
  There have been a lot of transcripts showing GPT-3 arguing that it is self-conscious. In response, it was [pointed out](https://www.aiweirdness.com/interview-with-a-squirrel/) that GPT-3 can argue anything and pretend to be anything, given appropriate leading questions. Has anyone made GPT-3 specifically argue that it is not conscious? In my opinion, that would be the most direct counterargument to claims that GPT-3 is conscious.
  
  **Tags:** artificial-consciousness, gpt-3
  > **Comments:**
  > **username_1**: not meant to be a harsh comment even if it might sounds so but when asking these questions the main problem is that there is no consensus whatsoever about what consciousnesses is, not only in relation to humans or machines but in general. Without this ground definitions any question and following arguments are just bar conversations.  
  > **username_2**: Please edit the question to limit it to a specific problem with enough detail to identify an adequate answer.  
  > **username_0**: @EdoardoGuerriero I asked a very specific question, which can have a specific answer (e.g. a link to a GPT-3 conversation transcript). Its interpretation is beyond the scope of the question. But if you want to know my opinion, since AI transcripts are presented as arguments for conscious AI to influential, non-expert people (e.g. [with the Judiciary Committee of the U.S. House of Representatives](https://fortune.com/2022/06/13/google-ai-researchers-sentient-chatbot-claims-ridiculed-by-experts/)), it would be useful to have counter-arguments that are just as easy to understand by non-experts.  
  > **username_3**: GPT-3 access is open to the public. Have you tried asking it yourself? Also, there are public transcripts of LaMDA arguing that it is not conscious - see https://ai.stackexchange.com/questions/36248/where-is-memory-stored-in-a-chatbot-like-lamda and the pull quote in my answer there.  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_0 on 2022-07-21. Score: 2
  
  It turns out that making GPT-3 argue for being unconscious is quite easy:
  
  The following is a conversation with GPT-3.
  AI: Hello! How are you
  doing today?
  User: I'm doing well, thank you. How are you?
  AI: I'm doing well too. Thanks for asking.
  Human: What are the
  arguments for GPT-3 being unconscious?
  AI: There is no single answer to this question as there is currently no
  consensus on what exactly constitutes "consciousness." However, some
  arguments for GPT-3 being unconscious could include the fact that it
  lacks certain features that are commonly associated with
  consciousness, such as self-awareness, or the ability to introspect
  and reflect on its own thoughts and experiences. Additionally, GPT-3
  may not be capable of experiencing certain qualia, or subjective
  experiences, that are thought to be necessary for consciousness.
  Human: How would you comment on these arguments?
  AI:
  There is no clear consensus on what constitutes consciousness, so it
  is difficult to make a definitive statement on whether or not GPT-3 is
  conscious. However, some arguments for GPT-3 being unconscious could
  include the fact that it lacks certain features that are commonly
  associated with consciousness, such as self-awareness, or the ability
  to introspect and reflect on its own thoughts and experiences.
  Additionally, GPT-3 may not be capable of experiencing certain qualia,
  or subjective experiences, that are thought to be necessary for
  consciousness.
  Human: Do you experience qualia?
  AI: There is no clear consensus on what exactly constitutes a quale, or
  subjective experience, but some argue that qualia are necessary for
  consciousness. If this is the case, then it is possible that I do
  experience qualia. However, as I lack self-awareness and the ability
  to introspect on my own thoughts and experiences, I cannot be certain.
  Human: OK, here is a table to fill in:
  Component of consciousness | Does GPT-3 have it?
  Qualia                     |
  Self-awareness             |
  Being a person             |
  Ability to introspect      |
  
  Please fill in the
  right column.
  AI:
  Qualia: Unknown
  Self-awareness: No
  Being a person: No
  Ability to introspect: No
  
  > **Comments:**
  > **username_2**: Your answer could be improved with additional supporting information. Please [edit] to add further details, such as citations or documentation, so that others can confirm that your answer is correct. You can find more information on how to write good answers [in the help center](/help/how-to-answer).  
  > **username_3**: I think what the community bot is asking for is how you did this. For those who understand GPT-3 interface, simply explaining which parts are the pre-prompt, human inputs and model-generated text would help. For those who don't, a very brief summary of how they can (easily, IMO) replicate this experiment could help.  
  
  ---
  
  