Body: <p>In reinforcement learning, when we talk about the principle of optimality, do we assume the policy to be deterministic?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2020-08-18T10:14:09.573Z
Comments.Text: Hi. Can you clarify what your question is? Is it "when we talk about the principle of optimality, do we assume policy to be deterministic?"
Comments.UserDisplayName: nbro
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2020-08-18T10:17:26.093Z
Comments.Text: Yes, that's what I meant
Comments.UserDisplayName: hakiki_makato
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2020-08-18T10:19:49.460Z
Comments.Text: Which "principle of optimality" are you talking about exactly? Where did you read this term? Maybe provide a reference to the book? Are you talking about the optimality of the _value iteration_ and/or _policy iteration_? I heard the term "principle of optimality" only in the context of dynamic programming algorithms.
Comments.UserDisplayName: nbro
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2020-08-18T10:22:40.663Z
Comments.Text: Yes, I'm reading Sutton-Barto, Introduction to Reinforcement learning. I'm asking in the context of DP only.
Comments.UserDisplayName: hakiki_makato
Tags: <reinforcement-learning><proofs><policies><deterministic-policy>
Title: Do we assume the policy to be deterministic when proving the optimality?
UserDisplayName: hakiki_makato
ThreadText: # Do we assume the policy to be deterministic when proving the optimality?
  
  (Asked by: username_0 on 2020-08-18)
  
  In reinforcement learning, when we talk about the principle of optimality, do we assume the policy to be deterministic?
  
  **Tags:** reinforcement-learning, proofs, policies, deterministic-policy
  > **Comments:**
  > **username_1**: Hi. Can you clarify what your question is? Is it "when we talk about the principle of optimality, do we assume policy to be deterministic?"  
  > **username_0**: Yes, that's what I meant  
  > **username_1**: Which "principle of optimality" are you talking about exactly? Where did you read this term? Maybe provide a reference to the book? Are you talking about the optimality of the _value iteration_ and/or _policy iteration_? I heard the term "principle of optimality" only in the context of dynamic programming algorithms.  
  > **username_0**: Yes, I'm reading Sutton-Barto, Introduction to Reinforcement learning. I'm asking in the context of DP only.  
  
  ---
  
  ## 0 answers
  
  