Answers.Body: <p>Your question suggests a confusion of <em>techniques</em>, <em>representations</em> and <em>problems</em>.</p>
  
  <ul>
  <li><p>Neural Networks are a <em>representation</em> that can be used to <em>approximate functions</em>. A neural network approximates a function that maps from inputs to outputs by optimizing parameters (weights).</p></li>
  <li><p>Genetic Algorithms are a <em>technique</em> that can be used to optimize a problem. You might chose to use a GA to optimize the weights in a neural network for instance. Or you might use it to optimize a different representation or approximation of a function.</p></li>
  <li><p>Reinforcement Learning is a <em>problem</em>. In a Reinforcement learning problem, the agent learns a function mapping states to actions. You can learn this function directly in some problem domains, or by a near-direct approximation (like tile-coding), or with a function appropriator (like a neural network).  </p></li>
  </ul>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-10-17T08:25:38.050Z
Answers.Text: Reinforcement Learning is also a field and a set of techniques to optimize a problem.
  
  The previous sentence is taken and summarized from Sutton and Barto (2018).
Answers.UserDisplayName: Dimitris Monroe
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-10-17T13:44:25.497Z
Answers.Text: @DimitrisMonroe It's true that people talk about Reinforcement Learning as a set of related techniques. However, what relates those techniques is their application to Reinforcement Learning problems. Sutton & Barto are correct that the group of people focused on this problem are large enough to claim they constitute a field, but it doesn't make sense to ask about the difference between RL & GAs, because GAs can be used to solve RL problems, but RL problems (or even techniques used to solve RL problems) cannot be used to "solve" GAs, because GAs are a search technique.
Answers.UserDisplayName: John Doucette
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-10-17T16:35:25.853Z
Answers.Text: This is a fair criticism but RL algorithms can theoretically solve a large number of problems even if they are well beyond the scope of the RL problem. An example of this is SecGan. Some people even attempt to write classifiers using DQNs and Policy Gradient Algorithms.
Answers.UserDisplayName: Dimitris Monroe
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-10-17T23:20:31.797Z
Answers.Text: @DimitrisMonroe That's true, but I think the issue is in calling them "RL" algorithms. Even though this usage is somewhat commonplace, they are really "algorithms for solving RL problems". Just as you can solve a classification problem with an algorithm for regression, you can solve a classification problem with an algorithm for RL, but that doesn't make regression a type of _solution_, even if we often lapse into talking about it that way. I think this is really an issue of semantics though.
Answers.UserDisplayName: John Doucette
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-10-18T05:41:42.703Z
Answers.Text: I agree with you, it's just semantics.
Answers.UserDisplayName: Dimitris Monroe
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-10-16T23:38:16.083Z
Answers.LastActivityDate: 2019-10-16T23:38:16.083Z
Answers.UserDisplayName: John Doucette
Body: <p>I'm looking for an "elevator pitch" breakdown of areas of applications for Reinforcement Learning &amp; Neural Networks vs. Genetic Algorithms, both actual and theoretical.</p>
  
  <p>Links are welcome, but please provide some explanation.</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2019-10-17T16:37:32.773Z
Comments.Text: @NeilSlater that broad scope was the intent.  (A twitter user asked a question about the differences in terms of types of applications suitable for the different techniques.)
Comments.UserDisplayName: DukeZhou
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2019-10-17T18:54:11.493Z
Comments.Text: @NeilSlater I didn't think sharing the Twitter post was relevant, per se, although here is a link: https://twitter.com/ezhillang/status/1184147600703836160.  *(Part of the reason I do a little outreach on Twitter is to try and promote participation on this stack.)*   PS--thanks for the the "elevator pitch" suggestion. I've edited the question to narrow it in this regard
Comments.UserDisplayName: DukeZhou
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2019-10-17T20:02:48.563Z
Comments.Text: Thanks for the edit. I don't think it is too broad now as you are clearly asking for a short summary. However, it does suffer a little from premises not quite being correct as a question (as John's answer points out), as does the original Twitter post IMO. That will mean that part of any answer has to spend time correcting the misunderstanding or miscommunication inherent in the question. Not sure how that can be avoided, it's a normal issue on this site when someone new to a subject uses slightly incorrect assumptions or terminology
Comments.UserDisplayName: Neil Slater
Tags: <neural-networks><reinforcement-learning><comparison><genetic-algorithms><applications>
Title: An "elevator pitch" breakdown of areas of applications for Reinforcement Learning & Neural Networks vs. Genetic Algorithms
UserDisplayName: DukeZhou
ThreadText: # An "elevator pitch" breakdown of areas of applications for Reinforcement Learning & Neural Networks vs. Genetic Algorithms
  
  (Asked by: username_0 on 2019-10-16)
  
  I'm looking for an "elevator pitch" breakdown of areas of applications for Reinforcement Learning & Neural Networks vs. Genetic Algorithms, both actual and theoretical.
  
  Links are welcome, but please provide some explanation.
  
  **Tags:** neural-networks, reinforcement-learning, comparison, genetic-algorithms, applications
  > **Comments:**
  > **username_0**: @NeilSlater that broad scope was the intent.  (A twitter user asked a question about the differences in terms of types of applications suitable for the different techniques.)  
  > **username_0**: @NeilSlater I didn't think sharing the Twitter post was relevant, per se, although here is a link: https://twitter.com/ezhillang/status/1184147600703836160.  *(Part of the reason I do a little outreach on Twitter is to try and promote participation on this stack.)*   PS--thanks for the the "elevator pitch" suggestion. I've edited the question to narrow it in this regard  
  > **username_1**: Thanks for the edit. I don't think it is too broad now as you are clearly asking for a short summary. However, it does suffer a little from premises not quite being correct as a question (as John's answer points out), as does the original Twitter post IMO. That will mean that part of any answer has to spend time correcting the misunderstanding or miscommunication inherent in the question. Not sure how that can be avoided, it's a normal issue on this site when someone new to a subject uses slightly incorrect assumptions or terminology  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_2 on 2019-10-16. Score: 4
  
  Your question suggests a confusion of *techniques*, *representations* and *problems*.
  
  * Neural Networks are a *representation* that can be used to *approximate functions*. A neural network approximates a function that maps from inputs to outputs by optimizing parameters (weights).
  * Genetic Algorithms are a *technique* that can be used to optimize a problem. You might chose to use a GA to optimize the weights in a neural network for instance. Or you might use it to optimize a different representation or approximation of a function.
  * Reinforcement Learning is a *problem*. In a Reinforcement learning problem, the agent learns a function mapping states to actions. You can learn this function directly in some problem domains, or by a near-direct approximation (like tile-coding), or with a function appropriator (like a neural network).
  
  > **Comments:**
  > **username_3**: Reinforcement Learning is also a field and a set of techniques to optimize a problem.  The previous sentence is taken and summarized from Sutton and Barto (2018).  
  > **username_2**: @DimitrisMonroe It's true that people talk about Reinforcement Learning as a set of related techniques. However, what relates those techniques is their application to Reinforcement Learning problems. Sutton & Barto are correct that the group of people focused on this problem are large enough to claim they constitute a field, but it doesn't make sense to ask about the difference between RL & GAs, because GAs can be used to solve RL problems, but RL problems (or even techniques used to solve RL problems) cannot be used to "solve" GAs, because GAs are a search technique.  
  > **username_3**: This is a fair criticism but RL algorithms can theoretically solve a large number of problems even if they are well beyond the scope of the RL problem. An example of this is SecGan. Some people even attempt to write classifiers using DQNs and Policy Gradient Algorithms.  
  > **username_2**: @DimitrisMonroe That's true, but I think the issue is in calling them "RL" algorithms. Even though this usage is somewhat commonplace, they are really "algorithms for solving RL problems". Just as you can solve a classification problem with an algorithm for regression, you can solve a classification problem with an algorithm for RL, but that doesn't make regression a type of _solution_, even if we often lapse into talking about it that way. I think this is really an issue of semantics though.  
  > **username_3**: I agree with you, it's just semantics.  
  
  ---
  
  