Answers.Body: <p>InstructGPTs are fine tuned GPT3.5 models. They have been tuned with different techniques to be good at following instructions and chatting. Examples of fine-tuning techniques are 1. Supervised fine-tuning on human demonstrations or 2. RLHF using PPO to maximise a reward model trained from comparisons by humans.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-04-10T07:01:32.413Z
Answers.Text: Hi! Thanks for your answer, this leaves me with the same question, though. If you see the first answer in this discussion: https://ai.stackexchange.com/questions/39023/are-gpt-3-5-series-models-based-on-gpt-3?newreg=d30affa2b8494f3faefd53868a57104e, the difference between InstructGPT and ChatGPT is confusing. Specifically, if the InstructGPT model does SFT, PPO, what does code-davinci-002 indicate?
Answers.UserDisplayName: Arya
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-04-10T17:23:47.273Z
Answers.Text: See here https://help.openai.com/en/articles/6195637-getting-started-with-codex
Answers.UserDisplayName: Rexcirus
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-04-07T22:38:26.340Z
Answers.LastActivityDate: 2023-04-07T22:38:26.340Z
Answers.UserDisplayName: Rexcirus
Body: <p>I read about the different model series in GPT3.5 here - <a href="https://platform.openai.com/docs/models/gpt-3-5" rel="nofollow noreferrer">https://platform.openai.com/docs/models/gpt-3-5</a></p>
  <p>At the beginning of the page, it mentions to look at <a href="https://platform.openai.com/docs/model-index-for-researchers" rel="nofollow noreferrer">https://platform.openai.com/docs/model-index-for-researchers</a> to understand the difference between model series InstructGPT and GPT3.5.</p>
  <p>But, on that page, it says InstructGPT is a part of the GPT3.5 series. So, what's the difference between GPT3.5 and InstructGPT?</p>
  
Tags: <comparison><open-ai><gpt><gpt-3><instruct-gpt>
Title: What's the difference between GPT3.5 and InstructGPT?
UserDisplayName: Arya
ThreadText: # What's the difference between GPT3.5 and InstructGPT?
  
  (Asked by: username_0 on 2023-04-06)
  
  I read about the different model series in GPT3.5 here - <https://platform.openai.com/docs/models/gpt-3-5>
  
  At the beginning of the page, it mentions to look at <https://platform.openai.com/docs/model-index-for-researchers> to understand the difference between model series InstructGPT and GPT3.5.
  
  But, on that page, it says InstructGPT is a part of the GPT3.5 series. So, what's the difference between GPT3.5 and InstructGPT?
  
  **Tags:** comparison, open-ai, gpt, gpt-3, instruct-gpt
  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2023-04-07. Score: 1
  
  InstructGPTs are fine tuned GPT3.5 models. They have been tuned with different techniques to be good at following instructions and chatting. Examples of fine-tuning techniques are 1. Supervised fine-tuning on human demonstrations or 2. RLHF using PPO to maximise a reward model trained from comparisons by humans.
  
  > **Comments:**
  > **username_0**: Hi! Thanks for your answer, this leaves me with the same question, though. If you see the first answer in this discussion: https://ai.stackexchange.com/questions/39023/are-gpt-3-5-series-models-based-on-gpt-3?newreg=d30affa2b8494f3faefd53868a57104e, the difference between InstructGPT and ChatGPT is confusing. Specifically, if the InstructGPT model does SFT, PPO, what does code-davinci-002 indicate?  
  > **username_1**: See here https://help.openai.com/en/articles/6195637-getting-started-with-codex  
  
  ---
  
  