Answers.Body: <p>There's no difference. As they too often do, ML researchers take concepts from other disciplines, conveniently forget to cite sources and change the terminology, leading to much confusion. RL is a textbook example (pun intended). Optimal control researchers have been studying very similar problems long before RL ones, and used standard symbols and terms (<span class="math-container">$x$</span> for states, <span class="math-container">$u$</span> for controls). Then RL researchers came and changed just about everything. </p>
  
  <p>See the paper <a href="https://arxiv.org/pdf/1806.09460.pdf" rel="nofollow noreferrer">A Tour of Reinforcement Learning: The View from Continuous Control</a> (2018), by Benjamin Recht, which discusses reinforcement learning from a control and optimization perspective.</p>
  
  <p>See also this tweet <a href="https://twitter.com/beenwrekt/status/1134536093980864514?s=21" rel="nofollow noreferrer">https://twitter.com/beenwrekt/status/1134536093980864514?s=21</a> (by Benjamin Recht) regarding the presentation of Sham Kakade.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-06-29T08:03:29.723Z
Answers.LastActivityDate: 2019-07-21T17:47:58.627Z
Answers.LastEditDate: 2019-07-21T17:47:58.627Z
Answers.UserDisplayName: DeltaIV
Body: <p>There are reinforcement learning papers (e.g. <a href="https://arxiv.org/pdf/1705.02670.pdf" rel="nofollow noreferrer">Metacontrol for Adaptive Imagination-Based Optimization</a>) that use (apparently, interchangeably) the term <em>control</em> or <em>action</em> to refer to the effect of the agent on the environment at each time step. </p>
  
  <p>Is there any difference between the terms <em>control</em> or <em>action</em> or are they (always) used interchangeably? If there is a difference, when is one term used as opposed to the other?</p>
  
  <p>The term control likely comes from the field of optimal control theory, which is related to reinforcement learning.</p>
  
Tags: <reinforcement-learning><terminology><comparison><control-theory>
Title: Is there any difference between a control and an action in reinforcement learning?
UserDisplayName: nbro
ThreadText: # Is there any difference between a control and an action in reinforcement learning?
  
  (Asked by: username_0 on 2019-06-28)
  
  There are reinforcement learning papers (e.g. [Metacontrol for Adaptive Imagination-Based Optimization](https://arxiv.org/pdf/1705.02670.pdf)) that use (apparently, interchangeably) the term *control* or *action* to refer to the effect of the agent on the environment at each time step.
  
  Is there any difference between the terms *control* or *action* or are they (always) used interchangeably? If there is a difference, when is one term used as opposed to the other?
  
  The term control likely comes from the field of optimal control theory, which is related to reinforcement learning.
  
  **Tags:** reinforcement-learning, terminology, comparison, control-theory
  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2019-06-29. Score: 3 | Accepted answer
  
  There's no difference. As they too often do, ML researchers take concepts from other disciplines, conveniently forget to cite sources and change the terminology, leading to much confusion. RL is a textbook example (pun intended). Optimal control researchers have been studying very similar problems long before RL ones, and used standard symbols and terms ($x$ for states, $u$ for controls). Then RL researchers came and changed just about everything.
  
  See the paper [A Tour of Reinforcement Learning: The View from Continuous Control](https://arxiv.org/pdf/1806.09460.pdf) (2018), by Benjamin Recht, which discusses reinforcement learning from a control and optimization perspective.
  
  See also this tweet <https://twitter.com/beenwrekt/status/1134536093980864514?s=21> (by Benjamin Recht) regarding the presentation of Sham Kakade.
  
  
  ---
  
  