Answers.Body: <p>The key difference between a learning agent and non-learning agents is that the learning agent can improve it's performance on it's own, allowing it to get "smarter".  </p>
  
  <p>Russel &amp; Norvig cover the different types of intelligent agents in detail in their textbook <a href="http://aima.cs.berkeley.edu/" rel="nofollow noreferrer">Artificial Intelligence: A Modern Approach</a>, and the <a href="https://en.wikipedia.org/wiki/Intelligent_agent#Learning_agents" rel="nofollow noreferrer">wikipedia entry for intelligent agent</a> mirrors their definitions. <em>[<a href="https://faculty.psau.edu.sa/filedownload/doc-7-pdf-a154ffbcec538a4161a406abf62f5b76-original.pdf" rel="nofollow noreferrer">Free pdf of the 3rd edition here</a>.]</em></p>
  
  <p>They break down agents into the following categories:</p>
  
  <ul>
  <li><a href="https://en.wikipedia.org/wiki/Intelligent_agent#/media/File:Simple_reflex_agent.png" rel="nofollow noreferrer">Simple reflex agents</a></li>
  <li><a href="https://en.wikipedia.org/wiki/Intelligent_agent#/media/File:Model_based_reflex_agent.png" rel="nofollow noreferrer">Model-based reflex agents</a></li>
  <li><a href="https://en.wikipedia.org/wiki/Intelligent_agent#/media/File:Model_based_goal_based_agent.png" rel="nofollow noreferrer">Goal-based agents</a></li>
  <li><a href="https://en.wikipedia.org/wiki/Intelligent_agent#/media/File:Model_based_utility_based.png" rel="nofollow noreferrer">Utility-based agents</a></li>
  <li><a href="https://en.wikipedia.org/wiki/Intelligent_agent#/media/File:IntelligentAgent-Learning.png" rel="nofollow noreferrer">Learning agents</a></li>
  </ul>
  
  <p>I'm not going to go into depth because understanding of technical terminology is required, but the links in the above list provide simple flow-chart explanations.</p>
  
  <p>In the first 4, the more sophisticated agents contain the primitive agents.  The model-based agent is actually a "model-based reflex agent", and the goal and utility agents are also model-based.</p>
  
  <p>You will notice is that <em>the structure changes fundamentally with the learning agent</em>.</p>
  
  <p>The key components of the learning agent are categorized as the "Critic", the "Learning Element", the "Performance Element", and "Problem Generator".  This structure allows the agent to evaluate past performance and modify subsequent actions to improve performance (learning).  The problem generator allows the agent to seek novel strategies (experimentation).</p>
  
  <p>Where the simple reflex agent operates under a "condition-action rule" (if a condition is met, take this action), the learning agent can improve it's decision-making beyond it's initial programming.</p>
  
  <hr>
  
  <p>Deep learning is a form of machine learning that uses <a href="https://en.wikipedia.org/wiki/Feature_learning" rel="nofollow noreferrer">representations</a>. In the most general sense, the algorithms use a trial and error and statistical analysis to optimize performance.  Various forms of <a href="https://en.wikipedia.org/wiki/Deep_learning#Neural_networks" rel="nofollow noreferrer">neural networks</a> are classified as deep learning systems. <em>[See also <a href="https://stackoverflow.com/questions/37973108/deep-reinforcement-learning-vs-reinforcement-learning">Deep Reinforcement Learning vs. Reinforcement Learning</a>.]</em> </p>
  
  <hr>
  
  <p>My sense is that learning agents can be applied to any type of problem in which parameters can be sufficiently defined.  I don't want to get too specific because there are many types of learning algorithms, but we've been seeing application of machine learning (in various forms) expanding significantly since ~2016.  This includes <a href="https://slate.com/business/2016/07/google-just-found-a-use-for-its-deepmind-acquisition.html" rel="nofollow noreferrer">replacing classical control systems</a>, <a href="https://www.technologyreview.com/s/604271/deep-learning-is-a-black-box-but-health-care-wont-mind/" rel="nofollow noreferrer">medical diagnostics</a>, <a href="https://en.wikipedia.org/wiki/Google_Neural_Machine_Translation" rel="nofollow noreferrer">natural language processing</a>, <a href="https://en.wikipedia.org/wiki/DeepFace" rel="nofollow noreferrer">image recognition</a>, and <a href="https://users.soe.ucsc.edu/~niejiazhong/slides/chandra.pdf" rel="nofollow noreferrer">consumer recommendations</a>. </p>
  
  <p>The applications are initially "narrow", defined as capability at a single task, but can be aggregated for tasks such as self-navigating vehicles which involve sets of discrete problems.  </p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2018-10-27T21:52:16.180Z
Answers.LastActivityDate: 2018-10-29T00:14:58.720Z
Answers.LastEditDate: 2018-10-29T00:14:58.720Z
Answers.UserDisplayName: DukeZhou
Answers.Body: <p>A learning agent is an agent which has a problem generator, a learning element, a critic and a performance element. ProbGen just creates different instances of a problem w.r.t. a domain and a set of parameters in jurisdiction. A learning element is responsible for making efficient choices and performance element chooses actions for the selected choice. It also changes some of the knowledge base. A critic is basically a metric to tell which is a better choice.</p>
  
  <p>Deep learning is a bit complicated than that. Then again, let's simplify. You see, deep learning is a specific arrangement or subsection of neural networks that helps the learning agent learn faster. That's as simply as I could explain it. What we do is that we arrange the layers in a neural network with a purpose and densely pack it to make it more task specific. Obviously, I am leaving out a lot of implementation details but for them, I am afraid, you need to look up a tutorial.</p>
  
  <p>How are they used in AI?
  That's problem specific. Learning agents are everywhere from spam detection to roombas to artificial dog pets. Deep learning on the other hand is currently focused on user pattern recognition and personalization in every front. Please let me know if you need me to expand upon this answer. </p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2018-10-27T13:39:03.680Z
Answers.LastActivityDate: 2018-10-27T13:39:03.680Z
Answers.UserDisplayName: GundamOfOasis
Body: <p>What is the difference between learning agents and other types of agents?</p>
  <p>In what ways learning agents can be applied? Do learning agents differ from deep learning?</p>
  
Tags: <deep-learning><comparison><intelligent-agent><learning-agents>
Title: What is the difference between learning and non-learning agents?
UserDisplayName: RashkRizwan
ThreadText: # What is the difference between learning and non-learning agents?
  
  (Asked by: username_0 on 2018-10-27)
  
  What is the difference between learning agents and other types of agents?
  
  In what ways learning agents can be applied? Do learning agents differ from deep learning?
  
  **Tags:** deep-learning, comparison, intelligent-agent, learning-agents
  
  
  ---
  
  ## 2 answers
  
  ### Answer by username_1 on 2018-10-27. Score: 1 | Accepted answer
  
  The key difference between a learning agent and non-learning agents is that the learning agent can improve it's performance on it's own, allowing it to get "smarter".
  
  Russel & Norvig cover the different types of intelligent agents in detail in their textbook [Artificial Intelligence: A Modern Approach](http://aima.cs.berkeley.edu/), and the [wikipedia entry for intelligent agent](https://en.wikipedia.org/wiki/Intelligent_agent#Learning_agents) mirrors their definitions. *[[Free pdf of the 3rd edition here](https://faculty.psau.edu.sa/filedownload/doc-7-pdf-a154ffbcec538a4161a406abf62f5b76-original.pdf).]*
  
  They break down agents into the following categories:
  
  * [Simple reflex agents](https://en.wikipedia.org/wiki/Intelligent_agent#/media/File:Simple_reflex_agent.png)
  * [Model-based reflex agents](https://en.wikipedia.org/wiki/Intelligent_agent#/media/File:Model_based_reflex_agent.png)
  * [Goal-based agents](https://en.wikipedia.org/wiki/Intelligent_agent#/media/File:Model_based_goal_based_agent.png)
  * [Utility-based agents](https://en.wikipedia.org/wiki/Intelligent_agent#/media/File:Model_based_utility_based.png)
  * [Learning agents](https://en.wikipedia.org/wiki/Intelligent_agent#/media/File:IntelligentAgent-Learning.png)
  
  I'm not going to go into depth because understanding of technical terminology is required, but the links in the above list provide simple flow-chart explanations.
  
  In the first 4, the more sophisticated agents contain the primitive agents. The model-based agent is actually a "model-based reflex agent", and the goal and utility agents are also model-based.
  
  You will notice is that *the structure changes fundamentally with the learning agent*.
  
  The key components of the learning agent are categorized as the "Critic", the "Learning Element", the "Performance Element", and "Problem Generator". This structure allows the agent to evaluate past performance and modify subsequent actions to improve performance (learning). The problem generator allows the agent to seek novel strategies (experimentation).
  
  Where the simple reflex agent operates under a "condition-action rule" (if a condition is met, take this action), the learning agent can improve it's decision-making beyond it's initial programming.
  
  ---
  
  Deep learning is a form of machine learning that uses [representations](https://en.wikipedia.org/wiki/Feature_learning). In the most general sense, the algorithms use a trial and error and statistical analysis to optimize performance. Various forms of [neural networks](https://en.wikipedia.org/wiki/Deep_learning#Neural_networks) are classified as deep learning systems. *[See also [Deep Reinforcement Learning vs. Reinforcement Learning](https://stackoverflow.com/questions/37973108/deep-reinforcement-learning-vs-reinforcement-learning).]*
  
  ---
  
  My sense is that learning agents can be applied to any type of problem in which parameters can be sufficiently defined. I don't want to get too specific because there are many types of learning algorithms, but we've been seeing application of machine learning (in various forms) expanding significantly since ~2016. This includes [replacing classical control systems](https://slate.com/business/2016/07/google-just-found-a-use-for-its-deepmind-acquisition.html), [medical diagnostics](https://www.technologyreview.com/s/604271/deep-learning-is-a-black-box-but-health-care-wont-mind/), [natural language processing](https://en.wikipedia.org/wiki/Google_Neural_Machine_Translation), [image recognition](https://en.wikipedia.org/wiki/DeepFace), and [consumer recommendations](https://users.soe.ucsc.edu/~niejiazhong/slides/chandra.pdf).
  
  The applications are initially "narrow", defined as capability at a single task, but can be aggregated for tasks such as self-navigating vehicles which involve sets of discrete problems.
  
  
  ---
  
  ### Answer by username_2 on 2018-10-27. Score: 1
  
  A learning agent is an agent which has a problem generator, a learning element, a critic and a performance element. ProbGen just creates different instances of a problem w.r.t. a domain and a set of parameters in jurisdiction. A learning element is responsible for making efficient choices and performance element chooses actions for the selected choice. It also changes some of the knowledge base. A critic is basically a metric to tell which is a better choice.
  
  Deep learning is a bit complicated than that. Then again, let's simplify. You see, deep learning is a specific arrangement or subsection of neural networks that helps the learning agent learn faster. That's as simply as I could explain it. What we do is that we arrange the layers in a neural network with a purpose and densely pack it to make it more task specific. Obviously, I am leaving out a lot of implementation details but for them, I am afraid, you need to look up a tutorial.
  
  How are they used in AI?
  That's problem specific. Learning agents are everywhere from spam detection to roombas to artificial dog pets. Deep learning on the other hand is currently focused on user pattern recognition and personalization in every front. Please let me know if you need me to expand upon this answer.
  
  
  ---
  
  