Answers.Body: <p>Let me see if this helps-</p>
  <p>I believe what you request is an understanding of whether or not Language models generate content to train themselves or other SOTA models.</p>
  <p>In short yes, Language models can automate tasks like data pre-processing, and data-preparing, and given the right algorithm (consider OpenAI's new function calling feature) even make decisions on writing the code to train themselves in an optimal manner by mere means of arguing with themselves.</p>
  <p>You might be aware of GANs which kind of do that (improve each other without much human interception).</p>
  <p>I mean consider all the prompt styles being researched and used, Chain-of-Thought, Tree-based-Chain-of-Thought, etc. If we can have LLM reason itself why can we not have it engineer textual data for us? It is coming, if you search you will find research in this direction. <a href="https://www.amazon.science/blog/using-large-language-models-llms-to-synthesize-training-data" rel="nofollow noreferrer">Here</a> is an example.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-07-02T06:11:02.957Z
Answers.LastActivityDate: 2023-07-02T06:11:02.957Z
Answers.UserDisplayName: Chinmay
Body: <p>In programming, if a new language could be improved by the language itself, it’s call self-hosting or bootstrapping.</p>
  <p>To develop generative AI, there’s some steps, data preparing, model training, fine tuning. Is it possible to use AI it self to help with these steps and make big improvement in efficiency?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2023-06-29T06:47:43.593Z
Comments.Text: Could you clarify what you mean by "AI itself"? That's very broad, it's a bit like asking about using "computers themselves" to improve computers, which is trivially true (chip designs are made on computers).
Comments.UserDisplayName: Neil Slater
Tags: <generative-model>
Title: Could generative AI bootstrap?
UserDisplayName: zzzgoo
ThreadText: # Could generative AI bootstrap?
  
  (Asked by: username_0 on 2023-06-29)
  
  In programming, if a new language could be improved by the language itself, it’s call self-hosting or bootstrapping.
  
  To develop generative AI, there’s some steps, data preparing, model training, fine tuning. Is it possible to use AI it self to help with these steps and make big improvement in efficiency?
  
  **Tags:** generative-model
  > **Comments:**
  > **username_1**: Could you clarify what you mean by "AI itself"? That's very broad, it's a bit like asking about using "computers themselves" to improve computers, which is trivially true (chip designs are made on computers).  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_2 on 2023-07-02. Score: 1
  
  Let me see if this helps-
  
  I believe what you request is an understanding of whether or not Language models generate content to train themselves or other SOTA models.
  
  In short yes, Language models can automate tasks like data pre-processing, and data-preparing, and given the right algorithm (consider OpenAI's new function calling feature) even make decisions on writing the code to train themselves in an optimal manner by mere means of arguing with themselves.
  
  You might be aware of GANs which kind of do that (improve each other without much human interception).
  
  I mean consider all the prompt styles being researched and used, Chain-of-Thought, Tree-based-Chain-of-Thought, etc. If we can have LLM reason itself why can we not have it engineer textual data for us? It is coming, if you search you will find research in this direction. [Here](https://www.amazon.science/blog/using-large-language-models-llms-to-synthesize-training-data) is an example.
  
  
  ---
  
  