Answers.Body: <p>This policy is usually referred to as the Behaviour Policy when talking about off-policy learning. It is the policy that actually takes actions in the world. The policy that one wants to learn, such as a greedy policy in Q learning, is know as the target policy. In this way the behaviour policy “logs” experience that the target policy (or policies) may learn from.</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-28T22:08:14.853Z
Answers.LastActivityDate: 2017-12-28T22:08:14.853Z
Answers.UserDisplayName: Jaden Travnik
Body: <p>I am reading <a href="https://arxiv.org/abs/1003.0120" rel="nofollow noreferrer">Learning from Logged Implicit Exploration Data</a> </p>
  
  <p>It says </p>
  
  <blockquote>
    <p>Formally, given a dataset of the form S = (x, a, r_a)* generated by the <strong>interaction of an uncontrolled logging policy</strong></p>
  </blockquote>
  
  <p>What is such a policy? </p>
  
Tags: <reinforcement-learning>
Title: What is uncontrolled logging policy?
UserDisplayName: wildfluss
ThreadText: # What is uncontrolled logging policy?
  
  (Asked by: username_0 on 2017-12-26)
  
  I am reading [Learning from Logged Implicit Exploration Data](https://arxiv.org/abs/1003.0120)
  
  It says
  
  > Formally, given a dataset of the form S = (x, a, r\_a)\* generated by the **interaction of an uncontrolled logging policy**
  
  What is such a policy?
  
  **Tags:** reinforcement-learning
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2017-12-28. Score: 2 | Accepted answer
  
  This policy is usually referred to as the Behaviour Policy when talking about off-policy learning. It is the policy that actually takes actions in the world. The policy that one wants to learn, such as a greedy policy in Q learning, is know as the target policy. In this way the behaviour policy “logs” experience that the target policy (or policies) may learn from.
  
  
  ---
  
  