<p>In reinforcement learning, when we talk about the principle of optimality, do we assume the policy to be deterministic?</p>

CC BY-SA 4.0
2020-08-18T10:14:09.573Z
Hi. Can you clarify what your question is? Is it "when we talk about the principle of optimality, do we assume policy to be deterministic?"
nbro
CC BY-SA 4.0
2020-08-18T10:17:26.093Z
Yes, that's what I meant
hakiki_makato
CC BY-SA 4.0
2020-08-18T10:19:49.460Z
Which "principle of optimality" are you talking about exactly? Where did you read this term? Maybe provide a reference to the book? Are you talking about the optimality of the _value iteration_ and/or _policy iteration_? I heard the term "principle of optimality" only in the context of dynamic programming algorithms.
nbro
CC BY-SA 4.0
2020-08-18T10:22:40.663Z
Yes, I'm reading Sutton-Barto, Introduction to Reinforcement learning. I'm asking in the context of DP only.
hakiki_makato
<reinforcement-learning><proofs><policies><deterministic-policy>
Do we assume the policy to be deterministic when proving the optimality?
hakiki_makato
# Do we assume the policy to be deterministic when proving the optimality?

(Asked by: username_0 on 2020-08-18)

In reinforcement learning, when we talk about the principle of optimality, do we assume the policy to be deterministic?

**Tags:** reinforcement-learning, proofs, policies, deterministic-policy

> **Comments:**
> **username_1**: Hi. Can you clarify what your question is? Is it "when we talk about the principle of optimality, do we assume policy to be deterministic?"  
> **username_0**: Yes, that's what I meant  
> **username_1**: Which "principle of optimality" are you talking about exactly? Where did you read this term? Maybe provide a reference to the book? Are you talking about the optimality of the _value iteration_ and/or _policy iteration_? I heard the term "principle of optimality" only in the context of dynamic programming algorithms.  
> **username_0**: Yes, I'm reading Sutton-Barto, Introduction to Reinforcement learning. I'm asking in the context of DP only.  

---

## 0 answers

