Answers.Body: <p>In a chat interaction with a language model like ChatGPT, the chat history literally becomes part of the prompt.</p>
  <p>If you enter a new prompt as part of a chat conversation, the whole chat history is prepended to the new prompt, and this is used to generate a new section of output.</p>
  <p>That means that a previous task can influence the behavior. But it also mean that you can remove that task from the history, by deleting earlier prompts and answers. This may or may not be supported by the user interface.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-03-22T14:41:42.190Z
Answers.LastActivityDate: 2023-03-22T14:41:42.190Z
Answers.UserDisplayName: Volker Siegel
Body: <p>For example, I guess that for some retrieval augmented LLMs, their generated contents may lack some creativity? Recent work has explored the inability of retrieval augmented methods to enhance the reasoning of LLMs. Then imagine a scenario where we prompt ChatGPT in order to have it implement a task related to information extraction, and suppose we continue the session process and we want it to answer a question for us ( here the task transform from <em>Information Extraction</em> to <em>Open-domain QA</em>), then will the LLM remain the same ability to answer a question?</p>
  <p>So, a natural consideration is: when prompt has become a paradigm for aligning LLM with human needs, how can we <strong>eliminate the impact of prompt and recover</strong> LLM?</p>
  <p>But perhaps a more economical strategy would be to open a new session window and give the LLM a prompt about the open-domain QA.</p>
  
Tags: <natural-language-processing><chatgpt><language-model><large-language-models><prompt>
Title: If we prompt a large language model on a task, will its ability for other tasks be affected? How to recover?
UserDisplayName: Iris88
ThreadText: # If we prompt a large language model on a task, will its ability for other tasks be affected? How to recover?
  
  (Asked by: username_0 on 2023-03-20)
  
  For example, I guess that for some retrieval augmented LLMs, their generated contents may lack some creativity? Recent work has explored the inability of retrieval augmented methods to enhance the reasoning of LLMs. Then imagine a scenario where we prompt ChatGPT in order to have it implement a task related to information extraction, and suppose we continue the session process and we want it to answer a question for us ( here the task transform from *Information Extraction* to *Open-domain QA*), then will the LLM remain the same ability to answer a question?
  
  So, a natural consideration is: when prompt has become a paradigm for aligning LLM with human needs, how can we **eliminate the impact of prompt and recover** LLM?
  
  But perhaps a more economical strategy would be to open a new session window and give the LLM a prompt about the open-domain QA.
  
  **Tags:** natural-language-processing, chatgpt, language-model, large-language-models, prompt
  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2023-03-22. Score: 2
  
  In a chat interaction with a language model like ChatGPT, the chat history literally becomes part of the prompt.
  
  If you enter a new prompt as part of a chat conversation, the whole chat history is prepended to the new prompt, and this is used to generate a new section of output.
  
  That means that a previous task can influence the behavior. But it also mean that you can remove that task from the history, by deleting earlier prompts and answers. This may or may not be supported by the user interface.
  
  
  ---
  
  