Answers.Body: <p>Unlike GPT-2/3 (and other language models around, such as OPT, PaLM, and BLOOM), it is trained <strong>not only on the texts</strong> downloaded from the Internet. After pre-training on purely textual data (OpenAI calls the base model GPT-3.5, and it is not entirely clear how it differs from GPT-3), it trained using <strong>human feedback</strong>. People involved in the training were instructed on the desired behavior of such a model. The instructions probably include reminding the users that ChatGPT is an AI. (There were in fact two types of human feedback: one was writing the desired answer, and the other was ranking or already generated model outputs.)</p>
  <p>Another way is adding this information to the initial prompt, which might not be visible to the user. It might be something like: &quot;I am an AI assistant called ChatGPT; I am polite and always helpful.&quot; Language models try to generate text that is coherent with what was previously written.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-01-12T10:40:32.607Z
Answers.LastActivityDate: 2023-01-12T10:40:32.607Z
Answers.UserDisplayName: Jindřich
Body: <p><a href="https://i.sstatic.net/3HZEb.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/3HZEb.png" alt="enter image description here" /></a></p>
  <p>I've tried several prompts to understand how does it &quot;know&quot; that it's an AI, but it's answers are inconclusive for me. It says that it was hard-coded to recognize keywords in this regard, which might mean that OpenAI might have trained it intensively on text about itself, but how exactly? my question remains</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2023-01-27T00:18:03.213Z
Comments.Text: Related: [What causes ChatGPT to generate responses that refer to itself as a bot or LM?](https://ai.stackexchange.com/q/38361/42632)
Comments.UserDisplayName: Rubén
Tags: <neural-networks><natural-language-processing><agi><chatgpt>
Title: How does chatGPT know it's an AI?
UserDisplayName: Jose Miguel Cruz y Celis
ThreadText: # How does chatGPT know it's an AI?
  
  (Asked by: username_0 on 2023-01-12)
  
  [![enter image description here](https://i.sstatic.net/3HZEb.png)](https://i.sstatic.net/3HZEb.png)
  
  I've tried several prompts to understand how does it "know" that it's an AI, but it's answers are inconclusive for me. It says that it was hard-coded to recognize keywords in this regard, which might mean that OpenAI might have trained it intensively on text about itself, but how exactly? my question remains
  
  **Tags:** neural-networks, natural-language-processing, agi, chatgpt
  > **Comments:**
  > **username_1**: Related: [What causes ChatGPT to generate responses that refer to itself as a bot or LM?](https://ai.stackexchange.com/q/38361/42632)  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_2 on 2023-01-12. Score: 7
  
  Unlike GPT-2/3 (and other language models around, such as OPT, PaLM, and BLOOM), it is trained **not only on the texts** downloaded from the Internet. After pre-training on purely textual data (OpenAI calls the base model GPT-3.5, and it is not entirely clear how it differs from GPT-3), it trained using **human feedback**. People involved in the training were instructed on the desired behavior of such a model. The instructions probably include reminding the users that ChatGPT is an AI. (There were in fact two types of human feedback: one was writing the desired answer, and the other was ranking or already generated model outputs.)
  
  Another way is adding this information to the initial prompt, which might not be visible to the user. It might be something like: "I am an AI assistant called ChatGPT; I am polite and always helpful." Language models try to generate text that is coherent with what was previously written.
  
  
  ---
  
  