Answers.Body: <p>The acclaimed book <a href="http://aima.cs.berkeley.edu/" rel="nofollow noreferrer">Artificial Intelligence: A Modern Approach</a> (by Stuart Russell and Peter Norvig) gives a definition of an agent</p>
  <blockquote>
  <p>An agent is anything that can be viewed as perceiving its environment through sensors and acting upon that environment through actuators.</p>
  </blockquote>
  <p>This definition is illustrated by the following figure</p>
  <p><a href="https://i.sstatic.net/qIpUW.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/qIpUW.png" alt="enter image description here" /></a></p>
  <p>This definition (and illustration) of an agent thus does not seem to include the agent as part of the environment, but this is debatable and can be a limitation, given that the environment also includes the agent.</p>
  <p>According to this definition, humans, robots, and programs are agents. For example, a human is an agent because it possesses sensors (e.g. the eyes) and actuators (e.g. the hands, which, in this case, are also sensors) and it interacts with an environment (the world).</p>
  <p>A <strong>percept</strong> (or perception) is composed of all perceptual inputs of the agents. The specific definition of the percept changes depending on the specific agent. For example, in the case of a human, the percept consists of all perceptual inputs from all sense organs of the human (eyes, ears, tongue, skin, and nose). In the case of a robot only equipped with a camera, the percept consists only of the camera frame (at a certain point in time). A <strong>percept sequence</strong> is a sequence of percepts.</p>
  <p>An <strong>action</strong> is anything that has an effect on the environment. For example, in the case of a legged robot, an action can be &quot;move forward&quot;.</p>
  <p>An action is chosen by the <strong>agent function</strong> (which is illustrated by the white box with a black question mark in the figure above), which can also be called <strong>policy</strong>. The agent function highly determines the intelligent or intellectual capabilities of the agent and differentiates it from other agents.</p>
  <p>Therefore, there are different agents depending on the sensors and actuators they possess, but, more importantly, depending on their policy, which highly affects their intellectual characteristics. A possible categorization of agents is</p>
  <ul>
  <li><p><strong>rational</strong> agents do the &quot;right&quot; thing (where &quot;right&quot;, of course, depends on the context)</p>
  </li>
  <li><p><strong>simple reflex</strong> agents select actions only based on the current percept (thus ignoring previous percepts)</p>
  </li>
  <li><p><strong>model-based reflex</strong> agents build a model of the world (sometimes called a <em>state</em>) that is used to deal with cases where the current percept is insufficient to take the most appropriate action</p>
  </li>
  <li><p><strong>goal-based</strong> agents possess some sort of <em>goal information</em> that describes situations that are desirable; for example, in the case of a human, a situation that is desirable is to have food</p>
  </li>
  <li><p><strong>utility-based</strong> agents associate value with certain actions more than others; for example, if you need immediate energy, chocolate might have more value than some vegetable</p>
  </li>
  <li><p><strong>learning</strong> agents update their e.g. model based on the experience or interaction with the environment</p>
  </li>
  </ul>
  <p>More details regarding these definitions can be found in section 2 of the book mentioned above (3rd edition). However, note that there are other possible categorizations of agents.</p>
  <p>A <strong>reinforcement learning</strong> (RL) agent is an agent that interacts with an <em>environment</em> and can learn a policy (a function that determines how the agent behaves) or value (or utility) function (from which the policy can be derived) from this interaction, where the agent takes an <em>action</em> from the <em>current state</em> of the environment, and the environment emits a percept, which, in the case of RL, consists of a <em>reinforcement</em> (or <em>reward</em>) signal and the <em>next state</em>. The goal of the RL agent is to maximize the cumulative reward (or reinforcement) signal. An RL agent can thus be considered a rational, goal, utility-based, and learning agent. It can also be (or not) a simple reflex and model-based agent.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-06-22T16:20:37.013Z
Answers.LastActivityDate: 2021-12-12T15:46:34.860Z
Answers.LastEditDate: 2021-12-12T15:46:34.860Z
Answers.UserDisplayName: nbro
Body: <p>While studying artificial intelligence, I have often encountered the term "agent" (often autonomous, intelligent). For instance, in fields such as Reinforcement Learning, Multi-Agent Systems, Game Theory, Markov Decision Processes.</p>
  
  <p>In an intuitive sense, it is clear to me what an agent is; I was wondering whether in AI it had a rigorous definition, perhaps expressed in mathematical language, and shared by the various AI-related fields.</p>
  
  <p><strong>What is an agent in Artificial Intelligence?</strong></p>
  
Tags: <reinforcement-learning><terminology><definitions><intelligent-agent>
Title: What is an agent in Artificial Intelligence?
UserDisplayName: olinarr
ThreadText: # What is an agent in Artificial Intelligence?
  
  (Asked by: username_0 on 2019-06-22)
  
  While studying artificial intelligence, I have often encountered the term "agent" (often autonomous, intelligent). For instance, in fields such as Reinforcement Learning, Multi-Agent Systems, Game Theory, Markov Decision Processes.
  
  In an intuitive sense, it is clear to me what an agent is; I was wondering whether in AI it had a rigorous definition, perhaps expressed in mathematical language, and shared by the various AI-related fields.
  
  **What is an agent in Artificial Intelligence?**
  
  **Tags:** reinforcement-learning, terminology, definitions, intelligent-agent
  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2019-06-22. Score: 4 | Accepted answer
  
  The acclaimed book [Artificial Intelligence: A Modern Approach](http://aima.cs.berkeley.edu/) (by Stuart Russell and Peter Norvig) gives a definition of an agent
  
  > An agent is anything that can be viewed as perceiving its environment through sensors and acting upon that environment through actuators.
  
  This definition is illustrated by the following figure
  
  [![enter image description here](https://i.sstatic.net/qIpUW.png)](https://i.sstatic.net/qIpUW.png)
  
  This definition (and illustration) of an agent thus does not seem to include the agent as part of the environment, but this is debatable and can be a limitation, given that the environment also includes the agent.
  
  According to this definition, humans, robots, and programs are agents. For example, a human is an agent because it possesses sensors (e.g. the eyes) and actuators (e.g. the hands, which, in this case, are also sensors) and it interacts with an environment (the world).
  
  A **percept** (or perception) is composed of all perceptual inputs of the agents. The specific definition of the percept changes depending on the specific agent. For example, in the case of a human, the percept consists of all perceptual inputs from all sense organs of the human (eyes, ears, tongue, skin, and nose). In the case of a robot only equipped with a camera, the percept consists only of the camera frame (at a certain point in time). A **percept sequence** is a sequence of percepts.
  
  An **action** is anything that has an effect on the environment. For example, in the case of a legged robot, an action can be "move forward".
  
  An action is chosen by the **agent function** (which is illustrated by the white box with a black question mark in the figure above), which can also be called **policy**. The agent function highly determines the intelligent or intellectual capabilities of the agent and differentiates it from other agents.
  
  Therefore, there are different agents depending on the sensors and actuators they possess, but, more importantly, depending on their policy, which highly affects their intellectual characteristics. A possible categorization of agents is
  
  * **rational** agents do the "right" thing (where "right", of course, depends on the context)
  * **simple reflex** agents select actions only based on the current percept (thus ignoring previous percepts)
  * **model-based reflex** agents build a model of the world (sometimes called a *state*) that is used to deal with cases where the current percept is insufficient to take the most appropriate action
  * **goal-based** agents possess some sort of *goal information* that describes situations that are desirable; for example, in the case of a human, a situation that is desirable is to have food
  * **utility-based** agents associate value with certain actions more than others; for example, if you need immediate energy, chocolate might have more value than some vegetable
  * **learning** agents update their e.g. model based on the experience or interaction with the environment
  
  More details regarding these definitions can be found in section 2 of the book mentioned above (3rd edition). However, note that there are other possible categorizations of agents.
  
  A **reinforcement learning** (RL) agent is an agent that interacts with an *environment* and can learn a policy (a function that determines how the agent behaves) or value (or utility) function (from which the policy can be derived) from this interaction, where the agent takes an *action* from the *current state* of the environment, and the environment emits a percept, which, in the case of RL, consists of a *reinforcement* (or *reward*) signal and the *next state*. The goal of the RL agent is to maximize the cumulative reward (or reinforcement) signal. An RL agent can thus be considered a rational, goal, utility-based, and learning agent. It can also be (or not) a simple reflex and model-based agent.
  
  
  ---
  
  