Answers.Body: <p>RL can be used in the context of Neural Architecture Search (NAS), with is a form of automated ML. A model searches for an architecture that performs a given task. How well this task is performed guides how the architecture will be modified (improved) on the next pass. It works but is very computation-intensive (think hundreds of GPUs).</p>
  
  <p>See for instance:</p>
  
  <ul>
  <li>B. Zoph and Q. V. Le (2016), <a href="https://arxiv.org/abs/1611.01578" rel="nofollow noreferrer">arxiv: 1611.01578</a>.</li>
  <li>B. Zoph, V. Vasudevan, J. Shlens, and Q. V. Le (2017), <a href="https://arxiv.org/abs/1707.07012" rel="nofollow noreferrer">arxiv: 1707.07012</a>.</li>
  <li>M. Tan, B. Chen, R. Pang, V. Vasudevan, and Q. V. Le (2018), <a href="https://arxiv.org/abs/1807.11626" rel="nofollow noreferrer">arxiv: 1807.11626</a>.</li>
  </ul>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-11-10T18:34:00.520Z
Answers.LastActivityDate: 2019-11-11T15:51:46.183Z
Answers.LastEditDate: 2019-11-11T15:51:46.183Z
Answers.UserDisplayName: Mathieu Bouville
Answers.Body: <p><a href="https://arxiv.org/pdf/1908.05557.pdf" rel="nofollow noreferrer">Automated machine learning</a> (<a href="https://arxiv.org/pdf/1810.13306.pdf" rel="nofollow noreferrer">AutoML</a>) is an <a href="https://en.wiktionary.org/wiki/umbrella_term" rel="nofollow noreferrer">umbrella term</a> that encompasses a collection of techniques (such as <a href="https://en.wikipedia.org/wiki/Hyperparameter_optimization" rel="nofollow noreferrer">hyper-parameter optimization</a> or <a href="https://en.wikipedia.org/wiki/Feature_learning" rel="nofollow noreferrer">automated</a> <a href="https://en.wikipedia.org/wiki/Feature_engineering" rel="nofollow noreferrer">feature engineering</a>) to <strong>automate</strong> the design and application of machine learning algorithms and models. </p>
  
  <p><a href="https://en.wikipedia.org/wiki/Reinforcement_learning" rel="nofollow noreferrer">Reinforcement learning (RL)</a> is a sub-field of machine learning concerned with the task of making decisions and taking actions in an environment so as to maximize (long-term) <strong>reward</strong> (which is the goal of the so-called RL agent). RL is (at least partially) based on the way animals (including humans) learn. For example, the usual way of <a href="https://en.wikipedia.org/wiki/Dog_training" rel="nofollow noreferrer">training a dog</a> to perform a certain task is to reward it with food whenever it takes the correct action (for example, jumping, if you want the dog to jump whenever you make a certain gesture with your hand). In this case, the RL agent is the dog, the task the dog needs to perform (e.g. jumping) is the environment, food is the reward and the goal is to get food.</p>
  
  <p>Given that reinforcement learning (RL) is a sub-field of machine learning, then, in principle, AutoML can also be used to automate the design of RL algorithms, models or agents. For example, if you use a neural network to represent the policy (the function the determines which action to take in the environment), then you can potentially use AutoML to find the most appropriate architecture (for example, the most appropriate number of layers) for this neural network.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-11-10T01:29:26.383Z
Answers.LastActivityDate: 2019-11-10T15:07:21.010Z
Answers.LastEditDate: 2019-11-10T15:07:21.010Z
Answers.UserDisplayName: nbro
Body: <p>My vague understanding of reinforcement learning (RL) is that it's very similar to supervised learning except that it updates on a continuous feed of data/activity, this to me sounds very similar to AutoML (which I've started to notice being used). </p>
  
  <p>Do they use different algorithms? What is the fundamental difference between RL and AutoML?</p>
  
  <p>I'm after an explanation for somebody who understands technology but does not work with machine learning tools regularly. </p>
  
Tags: <reinforcement-learning><comparison><supervised-learning><automated-machine-learning>
Title: What is the difference between reinforcement learning and AutoML?
UserDisplayName: user1605665
ThreadText: # What is the difference between reinforcement learning and AutoML?
  
  (Asked by: username_0 on 2019-11-09)
  
  My vague understanding of reinforcement learning (RL) is that it's very similar to supervised learning except that it updates on a continuous feed of data/activity, this to me sounds very similar to AutoML (which I've started to notice being used).
  
  Do they use different algorithms? What is the fundamental difference between RL and AutoML?
  
  I'm after an explanation for somebody who understands technology but does not work with machine learning tools regularly.
  
  **Tags:** reinforcement-learning, comparison, supervised-learning, automated-machine-learning
  
  
  ---
  
  ## 2 answers
  
  ### Answer by username_2 on 2019-11-10. Score: 3 | Accepted answer
  
  [Automated machine learning](https://arxiv.org/pdf/1908.05557.pdf) ([AutoML](https://arxiv.org/pdf/1810.13306.pdf)) is an [umbrella term](https://en.wiktionary.org/wiki/umbrella_term) that encompasses a collection of techniques (such as [hyper-parameter optimization](https://en.wikipedia.org/wiki/Hyperparameter_optimization) or [automated](https://en.wikipedia.org/wiki/Feature_learning) [feature engineering](https://en.wikipedia.org/wiki/Feature_engineering)) to **automate** the design and application of machine learning algorithms and models.
  
  [Reinforcement learning (RL)](https://en.wikipedia.org/wiki/Reinforcement_learning) is a sub-field of machine learning concerned with the task of making decisions and taking actions in an environment so as to maximize (long-term) **reward** (which is the goal of the so-called RL agent). RL is (at least partially) based on the way animals (including humans) learn. For example, the usual way of [training a dog](https://en.wikipedia.org/wiki/Dog_training) to perform a certain task is to reward it with food whenever it takes the correct action (for example, jumping, if you want the dog to jump whenever you make a certain gesture with your hand). In this case, the RL agent is the dog, the task the dog needs to perform (e.g. jumping) is the environment, food is the reward and the goal is to get food.
  
  Given that reinforcement learning (RL) is a sub-field of machine learning, then, in principle, AutoML can also be used to automate the design of RL algorithms, models or agents. For example, if you use a neural network to represent the policy (the function the determines which action to take in the environment), then you can potentially use AutoML to find the most appropriate architecture (for example, the most appropriate number of layers) for this neural network.
  
  
  ---
  
  ### Answer by username_1 on 2019-11-10. Score: 2
  
  RL can be used in the context of Neural Architecture Search (NAS), with is a form of automated ML. A model searches for an architecture that performs a given task. How well this task is performed guides how the architecture will be modified (improved) on the next pass. It works but is very computation-intensive (think hundreds of GPUs).
  
  See for instance:
  
  * B. Zoph and Q. V. Le (2016), [arxiv: 1611.01578](https://arxiv.org/abs/1611.01578).
  * B. Zoph, V. Vasudevan, J. Shlens, and Q. V. Le (2017), [arxiv: 1707.07012](https://arxiv.org/abs/1707.07012).
  * M. Tan, B. Chen, R. Pang, V. Vasudevan, and Q. V. Le (2018), [arxiv: 1807.11626](https://arxiv.org/abs/1807.11626).
  
  
  ---
  
  