Answers.Body: <p>If you give a human some input that doesn't seem to convey any meaning they will probably ask you for clarification. Presumably there are a lot of examples of this in the ChatGPT training data so that is exactly what it is going to do.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-03-21T07:54:13.927Z
Answers.LastActivityDate: 2023-03-21T07:54:13.927Z
Answers.UserDisplayName: quarague
Body: <p>My understanding of a transformer model is that it uses the given input to calculate internal query of relate-ness of word meanings, and generate a meaningful response based on its meaning. But if your given sentence has no meaning, then won't the model fail to capture any meaningful input so that the output will also be meaningless? How does the ChatGPT generate meaningful response asking me what I meant when the input is uncoordinated and meaningless? Is that a feature, or did they train on that kind of input specifically?<br />
  eg. Input &quot;Jumps the dog lazy fox over quick brown the.&quot;<br />
  For the output, ChatGPT asks for clarification.<br />
  Normally for a self-attention based model, there won't be any relation between input word for this example, so shouldn't the output also be garbage like?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2023-03-20T20:20:22.223Z
Comments.Text: can you give an example of a garbage input and output that you do not understand?
Comments.UserDisplayName: Criticize SE actions means ban
Tags: <transformer><attention><chatgpt><gpt>
Title: How does transformer models like GPT generate valid meaningful response for meaningless garbage input?
UserDisplayName: BlueSnake
ThreadText: # How does transformer models like GPT generate valid meaningful response for meaningless garbage input?
  
  (Asked by: username_0 on 2023-03-20)
  
  My understanding of a transformer model is that it uses the given input to calculate internal query of relate-ness of word meanings, and generate a meaningful response based on its meaning. But if your given sentence has no meaning, then won't the model fail to capture any meaningful input so that the output will also be meaningless? How does the ChatGPT generate meaningful response asking me what I meant when the input is uncoordinated and meaningless? Is that a feature, or did they train on that kind of input specifically?  
  eg. Input "Jumps the dog lazy fox over quick brown the."  
  For the output, ChatGPT asks for clarification.  
  Normally for a self-attention based model, there won't be any relation between input word for this example, so shouldn't the output also be garbage like?
  
  **Tags:** transformer, attention, chatgpt, gpt
  
  > **Comments:**
  > **username_1**: can you give an example of a garbage input and output that you do not understand?  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_2 on 2023-03-21. Score: 3 | Accepted answer
  
  If you give a human some input that doesn't seem to convey any meaning they will probably ask you for clarification. Presumably there are a lot of examples of this in the ChatGPT training data so that is exactly what it is going to do.
  
  
  ---
  
  