<p>This policy is usually referred to as the Behaviour Policy when talking about off-policy learning. It is the policy that actually takes actions in the world. The policy that one wants to learn, such as a greedy policy in Q learning, is know as the target policy. In this way the behaviour policy “logs” experience that the target policy (or policies) may learn from.</p>

CC BY-SA 3.0
2017-12-28T22:08:14.853Z
2017-12-28T22:08:14.853Z
Jaden Travnik
<p>I am reading <a href="https://arxiv.org/abs/1003.0120" rel="nofollow noreferrer">Learning from Logged Implicit Exploration Data</a> </p>

<p>It says </p>

<blockquote>
  <p>Formally, given a dataset of the form S = (x, a, r_a)* generated by the <strong>interaction of an uncontrolled logging policy</strong></p>
</blockquote>

<p>What is such a policy? </p>

<reinforcement-learning>
What is uncontrolled logging policy?
wildfluss
# What is uncontrolled logging policy?

(Asked by: username_0 on 2017-12-26)

I am reading [Learning from Logged Implicit Exploration Data](https://arxiv.org/abs/1003.0120)

It says

> Formally, given a dataset of the form S = (x, a, r\_a)\* generated by the **interaction of an uncontrolled logging policy**

What is such a policy?

**Tags:** reinforcement-learning


---

## 1 answers

### Answer by username_1 on 2017-12-28. Score: 2 | Accepted answer

This policy is usually referred to as the Behaviour Policy when talking about off-policy learning. It is the policy that actually takes actions in the world. The policy that one wants to learn, such as a greedy policy in Q learning, is know as the target policy. In this way the behaviour policy “logs” experience that the target policy (or policies) may learn from.


---

