Answers.Body: <p>I don't think there is a single standard word or phrase that covers just this concept. Perhaps <em>recursive self-improvement</em> matches the idea concisely - but that is not specific AI jargon.</p>
  
  <p>Very little is understood about what strength this effect can have or what the limits are. Will 10 generations of self-improvement lead to a machine that is 10% better, 10 times better, or <span class="math-container">$2^{10}$</span> times better? And by what measure? </p>
  
  <p>Some futurologists suggest this might be a very strong effect, and use the term <em>Singularity</em> to capture the idea that intelligence growth through recursive self-improvement will be strong, exceed human intelligence, and lead to some form of super-intelligent machine - the point at which this goal is reached is called <em>The Singularity</em>. <a href="https://en.wikipedia.org/wiki/The_Singularity_Is_Near" rel="noreferrer">Ray Kurzweil</a> is a well-known proponent of this idea. </p>
  
  <p>Specifically, use of the term <em>Singularity</em> implies more than just the basic recursion that you suggest, and includes assumptions of a very large effect. Plus technically, it refers to a stage that results from the recursion, not the recursion itself. </p>
  
  <p>However, despite the popularity of it as a concept, whether or not such self-improving system will have a large impact on the generation of intelligent machines is completely unknown at this stage. Related research about general intelligence is still in its infancy, so it is not even clear what would count as being the first example system x.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-10-30T18:07:44.870Z
Answers.Text: system x sounds good to me!
Answers.UserDisplayName: nickw
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-11-01T12:17:57.070Z
Answers.Text: Would it be fair to mention genetic algorithms? They do not operate on the same scale as @Ashwin is envisioning, but they create multiple different versions of itself and architecture, before testing and searching for which versions are best suited to solve their tasks, etc.
Answers.UserDisplayName: Krrrl
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-11-01T14:39:09.093Z
Answers.Text: @Krrrl: I don't think they are relevant in the context of this answer. Perhaps evolutionary algorithms might be part of a solution to self-improving systems, perhaps not.
Answers.UserDisplayName: Neil Slater
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-10-30T17:20:34.077Z
Answers.LastActivityDate: 2019-10-30T17:33:20.970Z
Answers.LastEditDate: 2019-10-30T17:33:20.970Z
Answers.UserDisplayName: Neil Slater
Answers.Body: <h3><strong>Direct Answer to Your Question</strong>:--</h3>
  
  <p>Google uses the term: <strong>Automated Machine Learning</strong>.</p>
  
  <hr>
  
  <h3><strong>What this Answer is About</strong>:--</h3>
  
  <blockquote>
    <p>" ... A general AI x creates another AI y which is better than x. ... " ~ Ashwin Rohit (Stack Exchange user, Opening Poster)</p>
  </blockquote>
  
  <p>What is the term for this: "A.I. creating A.I."?</p>
  
  <p>-</p>
  
  <p>What is some theory behind this:--</p>
  
  <blockquote>
    <p>"The AutoML procedure has so far been applied to image recognition and language modeling. Using AI alone, the team have observed it creating programs that are on par with state-of-the-art models designed by the world’s foremost experts on machine learning." – Google's AI Is Now Creating Its Own AI. (2017, May 22). Retrieved from &lt; <a href="https://www.iflscience.com/technology/google-ai-creating-own-ai/" rel="nofollow noreferrer">https://www.iflscience.com/technology/google-ai-creating-own-ai/</a> ></p>
  </blockquote>
  
  <hr>
  
  <h3><strong>Layperson Explanation</strong>:--</h3>
  
  <ul>
  <li><a href="https://www.mentalfloss.com/article/508019/googles-ai-can-make-its-own-ai-now" rel="nofollow noreferrer">Google's AI Can Make Its Own AI Now</a></li>
  <li><a href="https://www.alphr.com/artificial-intelligence/1007850/google-s-ai-builds-its-own-ai-child-and-it-s-better-than-anything" rel="nofollow noreferrer">Google’s AI builds its own AI child and it’s better than anything humans have made</a></li>
  <li><a href="https://www.sciencealert.com/google-is-improving-its-artificial-intelligence-with-artificial-intelligence" rel="nofollow noreferrer">Google Researchers Are Teaching Their AI to Build Its Own, More Powerful AI</a></li>
  </ul>
  
  <blockquote>
    <p>" ... Unfortunately, even people who have plenty of coding knowledge might not know how to create the kind of algorithm that can perform these tasks. Google wants to bring the ability to harness artificial intelligence to more people, though, and according to WIRED, it's doing that by teaching machine-learning software to make more machine-learning software.</p>
    
    <p>The project is called AutoML, and it's designed to come up with better machine-learning software than humans can. As algorithms become more important in scientific research, healthcare, and other fields outside the direct scope of robotics and math, the number of people who could benefit from using AI has outstripped the number of people who actually know how to set up a useful machine-learning program. Though computers can do a lot, according to Google, human experts are still needed to do things like preprocess the data, set parameters, and analyze the results. These are tasks that even developers may not have experience in. ... " </p>
    
    <p>– Google's AI Can Make Its Own AI Now. (2017, October 19). Retrieved from &lt; <a href="https://www.mentalfloss.com/article/508019/googles-ai-can-make-its-own-ai-now" rel="nofollow noreferrer">https://www.mentalfloss.com/article/508019/googles-ai-can-make-its-own-ai-now</a> ></p>
  </blockquote>
  
  <p>We use programs to write programs. </p>
  
  <p>Researchers often need tools to solve complicated problems and algorithms are often needed. They don't always have the technical experience to do this. This is an artificial intelligence-based solution to the ever-growing challenge of applying machine learning to this problem.</p>
  
  <p>This allows non-experts to engage in predictive performance of their final machine learning models.</p>
  
  <p>There is the potential of "feed-back between systems" when A.I. feeds into A.I., which continues to feed into itself, ad infinitum. </p>
  
  <hr>
  
  <h3>Business Applications and Practical Uses:--</h3>
  
  <p>Defer to the book: <em>Automated Machine Learning for Business</em>.</p>
  
  <ul>
  <li><p><a href="https://www.bigsquid.com/accelerate-your-data-value-journey-with-automated-machine-learning" rel="nofollow noreferrer">Accelerate your Data Value Journey with Automated Machine Learning</a></p></li>
  <li><p><a href="https://www.bigsquid.com/medical-tech-machine-learning" rel="nofollow noreferrer">Leveraging the Power of Machine Learning to Save Lives</a> [This is not medical advice.]</p></li>
  </ul>
  
  <hr>
  
  <h3><strong>Technical Mirror</strong>:--</h3>
  
  <ul>
  <li>(<a href="http://www.ml4aad.org/automl/" rel="nofollow noreferrer">http://www.ml4aad.org/automl/</a>)</li>
  </ul>
  
  <blockquote>
    <p>"What is AutoML?
    Automated Machine Learning provides methods and processes to make Machine Learning available for non-Machine Learning experts, to improve efficiency of Machine Learning and to accelerate research on Machine Learning.</p>
    
    <p>Machine learning (ML) has achieved considerable successes in recent years and an ever-growing number of disciplines rely on it. However, this success crucially relies on human machine learning experts to perform the following tasks:</p>
    
    <ul>
    <li>Preprocess and clean the data.</li>
    <li>Select and construct appropriate features.</li>
    <li>Select an appropriate model family.</li>
    <li>Optimize model hyperparameters.</li>
    <li>Postprocess machine learning models.</li>
    <li>Critically analyze the results obtained.</li>
    </ul>
    
    <p>As the complexity of these tasks is often beyond non-ML-experts, the rapid growth of machine learning applications has created a demand for off-the-shelf machine learning methods that can be used easily and without expert knowledge. We call the resulting research area that targets progressive automation of machine learning AutoML." </p>
    
    <p>– AutoML. (n.d.). Retrieved from &lt; <a href="http://www.ml4aad.org/automl/" rel="nofollow noreferrer">http://www.ml4aad.org/automl/</a> ></p>
  </blockquote>
  
  <ul>
  <li>(<a href="https://en.wikipedia.org/wiki/Automated_machine_learning" rel="nofollow noreferrer">https://en.wikipedia.org/wiki/Automated_machine_learning</a>)</li>
  <li>(<a href="https://www.researchgate.net/publication/237136437_The_Nature_of_Self-Improving_Artificial_Intelligence" rel="nofollow noreferrer">https://www.researchgate.net/publication/237136437_The_Nature_of_Self-Improving_Artificial_Intelligence</a>)</li>
  </ul>
  
  <hr>
  
  <h3>Sources and References; and Further Reading:--</h3>
  
  <ul>
  <li>(<a href="https://ai.googleblog.com/2017/05/using-machine-learning-to-explore.html" rel="nofollow noreferrer">https://ai.googleblog.com/2017/05/using-machine-learning-to-explore.html</a>)</li>
  <li>(<a href="http://www.primaryobjects.com/2013/01/27/using-artificial-intelligence-to-write-self-modifying-improving-programs/" rel="nofollow noreferrer">http://www.primaryobjects.com/2013/01/27/using-artificial-intelligence-to-write-self-modifying-improving-programs/</a>)</li>
  <li>(<a href="https://skymind.ai/wiki/automl-automated-machine-learning-ai" rel="nofollow noreferrer">https://skymind.ai/wiki/automl-automated-machine-learning-ai</a>)</li>
  <li>(<a href="https://www.datarobot.com/wiki/automated-machine-learning/" rel="nofollow noreferrer">https://www.datarobot.com/wiki/automated-machine-learning/</a>)</li>
  <li>(<a href="https://blog.aimultiple.com/auto-ml/" rel="nofollow noreferrer">https://blog.aimultiple.com/auto-ml/</a>)</li>
  <li>(<a href="https://powerbi.microsoft.com/en-us/blog/announcing-automated-machine-learning-in-power-bi-general-availability/" rel="nofollow noreferrer">https://powerbi.microsoft.com/en-us/blog/announcing-automated-machine-learning-in-power-bi-general-availability/</a>)</li>
  </ul>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-11-05T01:12:05.677Z
Answers.Text: I strongly disagree that AutoML is relevant to recursive self-improvement. The Mental Floss headline is misleading. Even interpreting it charitably, it is only giving one level of improvement, not recursive. AutoML doesn't create new ML programs, it just automates some training.
Answers.UserDisplayName: jmmcd
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-11-04T01:46:46.793Z
Answers.LastActivityDate: 2019-11-05T06:36:44.837Z
Answers.LastEditDate: 2019-11-05T06:36:44.837Z
Answers.UserDisplayName: Donate to the Edhi Foundation
Answers.Body: <p>The first thing that comes to mind when reading your question is <em><a href="https://en.wikipedia.org/wiki/Genetic_algorithm" rel="nofollow noreferrer">Genetic algorithms</a></em>.</p>
  
  <p>They create alternate versions of themselves and measure each versions performance on a specific task, before discarding those that work poorly, while keeping the best ones for their next generation.
  The mutations here are often random, and for large/complex problems, these simulations can take incredibly long time.
  This group of algorithms are heavily inspired by evolution and biology, as you can see.</p>
  
  <p>I realize as I read the last part of your question, that this might be on a much smaller scope than you had envisioned. But, in essence genetic algorithms does what you describe in your first part.</p>
  
  <p>For the more grand-scale question, see @Neil Slater's answer.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-11-01T14:43:40.547Z
Answers.Text: Usually genetic algoriths don't "create alternate versions of themselves", but they manage a search within a loosely-defined space. The GA mechanisms in play (interpretation of the genome, assessing fitness, selection, creating next generation) are not the subjects themselves of evoltionary algorithms. They could be, in principle, but you would need to define a fitness function for them, which is hard.
Answers.UserDisplayName: Neil Slater
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-11-01T15:58:43.193Z
Answers.Text: I see now that my formulation there was inaccurate.
  I agree about the fitness function, but I could only think of GA as a collective of methods that "try to find a better AI" - apart from your answer about the singularity - which I admit sounds more like what Ashwin is asking about here.
Answers.UserDisplayName: Krrrl
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-11-04T02:33:25.903Z
Answers.Text: Respectfully, can we get some sources to back this answer up?
Answers.UserDisplayName: Donate to the Edhi Foundation
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-11-05T10:07:36.680Z
Answers.Text: An answer being counter-intuitive (e.g. linking genetics with A.I.) does not necessarily mean it is wrong/invalid.
Answers.UserDisplayName: Donate to the Edhi Foundation
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-11-06T15:25:59.870Z
Answers.Text: @Tautologicalrevelations John Doucette edited in a link to the genetic algorithms page. Sorry for not being precise enough in my original reply.
Answers.UserDisplayName: Krrrl
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-11-06T15:30:20.043Z
Answers.Text: I think your answer is interesting. I don't know much about genetics. Best wishes. :)
Answers.UserDisplayName: Donate to the Edhi Foundation
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-11-01T12:22:32.630Z
Answers.LastActivityDate: 2019-11-04T16:09:51.837Z
Answers.LastEditDate: 2019-11-04T16:09:51.837Z
Answers.UserDisplayName: Krrrl
Body: <p>A general AI <em>x</em> creates another AI <em>y</em> which is better than <em>x</em>.</p>
  
  <p><em>y</em> creates an AI better than itself.</p>
  
  <p>And so on, with each generation's primary goal to create a better AI.</p>
  
  <p>Is there a name for this.</p>
  
  <p>By better, I mean survivability, ability to solve new problems, enhance human life physically and mentally, and advance our civilization to an intergalactic civilization to name a few.</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2019-11-03T15:14:59.153Z
Comments.Text: Not marking any as answer as many people might provide their own take on this, otherwise, one would just see the answer marked as answer and not see other ones which might provide greater insight into AI.
Comments.UserDisplayName: Ashwin Rohit
Tags: <terminology><evolutionary-algorithms><agi>
Title: What is the name of an AI whose primary goal is to create a better AI?
UserDisplayName: Ashwin Rohit
ThreadText: # What is the name of an AI whose primary goal is to create a better AI?
  
  (Asked by: username_0 on 2019-10-30)
  
  A general AI *x* creates another AI *y* which is better than *x*.
  
  *y* creates an AI better than itself.
  
  And so on, with each generation's primary goal to create a better AI.
  
  Is there a name for this.
  
  By better, I mean survivability, ability to solve new problems, enhance human life physically and mentally, and advance our civilization to an intergalactic civilization to name a few.
  
  **Tags:** terminology, evolutionary-algorithms, agi
  > **Comments:**
  > **username_0**: Not marking any as answer as many people might provide their own take on this, otherwise, one would just see the answer marked as answer and not see other ones which might provide greater insight into AI.  
  
  ---
  
  ## 3 answers
  
  ### Answer by username_1 on 2019-10-30. Score: 6
  
  I don't think there is a single standard word or phrase that covers just this concept. Perhaps *recursive self-improvement* matches the idea concisely - but that is not specific AI jargon.
  
  Very little is understood about what strength this effect can have or what the limits are. Will 10 generations of self-improvement lead to a machine that is 10% better, 10 times better, or $2^{10}$ times better? And by what measure?
  
  Some futurologists suggest this might be a very strong effect, and use the term *Singularity* to capture the idea that intelligence growth through recursive self-improvement will be strong, exceed human intelligence, and lead to some form of super-intelligent machine - the point at which this goal is reached is called *The Singularity*. [Ray Kurzweil](https://en.wikipedia.org/wiki/The_Singularity_Is_Near) is a well-known proponent of this idea.
  
  Specifically, use of the term *Singularity* implies more than just the basic recursion that you suggest, and includes assumptions of a very large effect. Plus technically, it refers to a stage that results from the recursion, not the recursion itself.
  
  However, despite the popularity of it as a concept, whether or not such self-improving system will have a large impact on the generation of intelligent machines is completely unknown at this stage. Related research about general intelligence is still in its infancy, so it is not even clear what would count as being the first example system x.
  
  > **Comments:**
  > **username_2**: system x sounds good to me!  
  > **username_3**: Would it be fair to mention genetic algorithms? They do not operate on the same scale as @Ashwin is envisioning, but they create multiple different versions of itself and architecture, before testing and searching for which versions are best suited to solve their tasks, etc.  
  > **username_1**: @Krrrl: I don't think they are relevant in the context of this answer. Perhaps evolutionary algorithms might be part of a solution to self-improving systems, perhaps not.  
  
  ---
  
  ### Answer by username_4 on 2019-11-04. Score: 2
  
  ### **Direct Answer to Your Question**:--
  
  Google uses the term: **Automated Machine Learning**.
  
  ---
  
  ### **What this Answer is About**:--
  
  > " ... A general AI x creates another AI y which is better than x. ... " ~ Ashwin Rohit (Stack Exchange user, Opening Poster)
  
  What is the term for this: "A.I. creating A.I."?
  
  -
  
  What is some theory behind this:--
  
  > "The AutoML procedure has so far been applied to image recognition and language modeling. Using AI alone, the team have observed it creating programs that are on par with state-of-the-art models designed by the world’s foremost experts on machine learning." – Google's AI Is Now Creating Its Own AI. (2017, May 22). Retrieved from < <https://www.iflscience.com/technology/google-ai-creating-own-ai/> >
  
  ---
  
  ### **Layperson Explanation**:--
  
  * [Google's AI Can Make Its Own AI Now](https://www.mentalfloss.com/article/508019/googles-ai-can-make-its-own-ai-now)
  * [Google’s AI builds its own AI child and it’s better than anything humans have made](https://www.alphr.com/artificial-intelligence/1007850/google-s-ai-builds-its-own-ai-child-and-it-s-better-than-anything)
  * [Google Researchers Are Teaching Their AI to Build Its Own, More Powerful AI](https://www.sciencealert.com/google-is-improving-its-artificial-intelligence-with-artificial-intelligence)
  
  > " ... Unfortunately, even people who have plenty of coding knowledge might not know how to create the kind of algorithm that can perform these tasks. Google wants to bring the ability to harness artificial intelligence to more people, though, and according to WIRED, it's doing that by teaching machine-learning software to make more machine-learning software.
  >
  > The project is called AutoML, and it's designed to come up with better machine-learning software than humans can. As algorithms become more important in scientific research, healthcare, and other fields outside the direct scope of robotics and math, the number of people who could benefit from using AI has outstripped the number of people who actually know how to set up a useful machine-learning program. Though computers can do a lot, according to Google, human experts are still needed to do things like preprocess the data, set parameters, and analyze the results. These are tasks that even developers may not have experience in. ... "
  >
  > – Google's AI Can Make Its Own AI Now. (2017, October 19). Retrieved from < <https://www.mentalfloss.com/article/508019/googles-ai-can-make-its-own-ai-now> >
  
  We use programs to write programs.
  
  Researchers often need tools to solve complicated problems and algorithms are often needed. They don't always have the technical experience to do this. This is an artificial intelligence-based solution to the ever-growing challenge of applying machine learning to this problem.
  
  This allows non-experts to engage in predictive performance of their final machine learning models.
  
  There is the potential of "feed-back between systems" when A.I. feeds into A.I., which continues to feed into itself, ad infinitum.
  
  ---
  
  ### Business Applications and Practical Uses:--
  
  Defer to the book: *Automated Machine Learning for Business*.
  
  * [Accelerate your Data Value Journey with Automated Machine Learning](https://www.bigsquid.com/accelerate-your-data-value-journey-with-automated-machine-learning)
  * [Leveraging the Power of Machine Learning to Save Lives](https://www.bigsquid.com/medical-tech-machine-learning) [This is not medical advice.]
  
  ---
  
  ### **Technical Mirror**:--
  
  * (<http://www.ml4aad.org/automl/>)
  
  > "What is AutoML?
  > Automated Machine Learning provides methods and processes to make Machine Learning available for non-Machine Learning experts, to improve efficiency of Machine Learning and to accelerate research on Machine Learning.
  >
  > Machine learning (ML) has achieved considerable successes in recent years and an ever-growing number of disciplines rely on it. However, this success crucially relies on human machine learning experts to perform the following tasks:
  >
  > * Preprocess and clean the data.
  > * Select and construct appropriate features.
  > * Select an appropriate model family.
  > * Optimize model hyperparameters.
  > * Postprocess machine learning models.
  > * Critically analyze the results obtained.
  >
  > As the complexity of these tasks is often beyond non-ML-experts, the rapid growth of machine learning applications has created a demand for off-the-shelf machine learning methods that can be used easily and without expert knowledge. We call the resulting research area that targets progressive automation of machine learning AutoML."
  >
  > – AutoML. (n.d.). Retrieved from < <http://www.ml4aad.org/automl/> >
  
  * (<https://en.wikipedia.org/wiki/Automated_machine_learning>)
  * (<https://www.researchgate.net/publication/237136437_The_Nature_of_Self-Improving_Artificial_Intelligence>)
  
  ---
  
  ### Sources and References; and Further Reading:--
  
  * (<https://ai.googleblog.com/2017/05/using-machine-learning-to-explore.html>)
  * (<http://www.primaryobjects.com/2013/01/27/using-artificial-intelligence-to-write-self-modifying-improving-programs/>)
  * (<https://skymind.ai/wiki/automl-automated-machine-learning-ai>)
  * (<https://www.datarobot.com/wiki/automated-machine-learning/>)
  * (<https://blog.aimultiple.com/auto-ml/>)
  * (<https://powerbi.microsoft.com/en-us/blog/announcing-automated-machine-learning-in-power-bi-general-availability/>)
  
  > **Comments:**
  > **username_5**: I strongly disagree that AutoML is relevant to recursive self-improvement. The Mental Floss headline is misleading. Even interpreting it charitably, it is only giving one level of improvement, not recursive. AutoML doesn't create new ML programs, it just automates some training.  
  
  ---
  
  ### Answer by username_3 on 2019-11-01. Score: 1
  
  The first thing that comes to mind when reading your question is *[Genetic algorithms](https://en.wikipedia.org/wiki/Genetic_algorithm)*.
  
  They create alternate versions of themselves and measure each versions performance on a specific task, before discarding those that work poorly, while keeping the best ones for their next generation.
  The mutations here are often random, and for large/complex problems, these simulations can take incredibly long time.
  This group of algorithms are heavily inspired by evolution and biology, as you can see.
  
  I realize as I read the last part of your question, that this might be on a much smaller scope than you had envisioned. But, in essence genetic algorithms does what you describe in your first part.
  
  For the more grand-scale question, see @Neil Slater's answer.
  
  > **Comments:**
  > **username_1**: Usually genetic algoriths don't "create alternate versions of themselves", but they manage a search within a loosely-defined space. The GA mechanisms in play (interpretation of the genome, assessing fitness, selection, creating next generation) are not the subjects themselves of evoltionary algorithms. They could be, in principle, but you would need to define a fitness function for them, which is hard.  
  > **username_3**: I see now that my formulation there was inaccurate. I agree about the fitness function, but I could only think of GA as a collective of methods that "try to find a better AI" - apart from your answer about the singularity - which I admit sounds more like what Ashwin is asking about here.  
  > **username_4**: Respectfully, can we get some sources to back this answer up?  
  > **username_4**: An answer being counter-intuitive (e.g. linking genetics with A.I.) does not necessarily mean it is wrong/invalid.  
  > **username_3**: @Tautologicalrevelations John Doucette edited in a link to the genetic algorithms page. Sorry for not being precise enough in my original reply.  
  > **username_4**: I think your answer is interesting. I don't know much about genetics. Best wishes. :)  
  
  ---
  
  