Answers.Body: <p>The core model for ChatGPT, a Large Language Model (LLM), is <em>not</em> updated in real time during chats.</p>
  <p>The chat history <em>can</em> be saved, and if so used by OpenAI to train models for future releases.</p>
  <p>You can see this option in Settings:</p>
  <p><a href="https://i.sstatic.net/9I1Q3.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/9I1Q3.png" alt="ChatGPT data control settings showing training option" /></a></p>
  <p>However, there have been leaked/previewed plans for changes to the higher level software (i.e. the input/output control that <em>uses</em> the model), and as part of that OpenAI have added a mechanism whereby the bot will somehow store key data from conversations, and use this data to customise responses. As an educated guess, this is probably a text summary (generated by an LLM reading the conversations) stored as reference data or as a second &quot;system prompt&quot;. This new feature in progress <a href="https://community.openai.com/t/project-sunshine-live-i-just-saw-a-popup-explaining-a-new-memory-feature-i-am-curious-and-would-love-to-learn-more-about-how-chatgpt-stores-data-between-sessions-more/580226" rel="nofollow noreferrer">has been labelled &quot;Project Sunshine&quot; by commenters</a>. OpenAI have not formally confirmed this or released details of how that works AFAICS, but it seems like the ability to enable this, and to clear this personalised memory, will also appear in Settings.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2024-01-14T20:59:09.230Z
Answers.Text: Honestly it should retrain itself on accumulated data(perhaps it will in the future). Eventually you will get novel conversations where each bot is talking to another bot.
Answers.UserDisplayName: FourierFlux
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2024-01-15T16:13:56.437Z
Answers.Text: @FourierFlux but retraining is expensive and cause catastrophic forgetting if not done properly
Answers.UserDisplayName: John Jiang
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2024-01-14T17:35:08.887Z
Answers.LastActivityDate: 2024-01-15T16:27:43.310Z
Answers.LastEditDate: 2024-01-15T16:27:43.310Z
Answers.UserDisplayName: Neil Slater
Body: <p>Does Chat-GPT accumulate knowledge through interactions with users in real time? I know it's trained on a massive dataset but does it do online learning?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2024-01-14T18:15:18.670Z
Comments.Text: Questions about specific products are off-topic here.
Comments.UserDisplayName: nbro
Tags: <training><chatgpt>
Title: Does Chat-GPT learn from interactions?
UserDisplayName: FourierFlux
ThreadText: # Does Chat-GPT learn from interactions?
  
  (Asked by: username_0 on 2024-01-14)
  
  Does Chat-GPT accumulate knowledge through interactions with users in real time? I know it's trained on a massive dataset but does it do online learning?
  
  **Tags:** training, chatgpt
  > **Comments:**
  > **username_1**: Questions about specific products are off-topic here.  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_2 on 2024-01-14. Score: 1 | Accepted answer
  
  The core model for ChatGPT, a Large Language Model (LLM), is *not* updated in real time during chats.
  
  The chat history *can* be saved, and if so used by OpenAI to train models for future releases.
  
  You can see this option in Settings:
  
  [![ChatGPT data control settings showing training option](https://i.sstatic.net/9I1Q3.png)](https://i.sstatic.net/9I1Q3.png)
  
  However, there have been leaked/previewed plans for changes to the higher level software (i.e. the input/output control that *uses* the model), and as part of that OpenAI have added a mechanism whereby the bot will somehow store key data from conversations, and use this data to customise responses. As an educated guess, this is probably a text summary (generated by an LLM reading the conversations) stored as reference data or as a second "system prompt". This new feature in progress [has been labelled "Project Sunshine" by commenters](https://community.openai.com/t/project-sunshine-live-i-just-saw-a-popup-explaining-a-new-memory-feature-i-am-curious-and-would-love-to-learn-more-about-how-chatgpt-stores-data-between-sessions-more/580226). OpenAI have not formally confirmed this or released details of how that works AFAICS, but it seems like the ability to enable this, and to clear this personalised memory, will also appear in Settings.
  
  > **Comments:**
  > **username_0**: Honestly it should retrain itself on accumulated data(perhaps it will in the future). Eventually you will get novel conversations where each bot is talking to another bot.  
  > **username_3**: @FourierFlux but retraining is expensive and cause catastrophic forgetting if not done properly  
  
  ---
  
  