Answers.Body: <p>I am not an expert in this area. But I believe that the word "Deterministic" is for "Policy" in the "Deterministic Policy" Gradient. It does not mean  deterministic environment.</p>
  
  <p>Stochastic policy: Probabilistic(random) action choice for a given state.<br>
  Deterministic policy: one action is chosen for a given state. </p>
  
  <p>Deterministic Policy Gradient algorithm still can handle a stochastic (and continuous, of cause) environment, but the policy will be deterministic. </p>
  
  <p>Reference  </p>
  
  <p>"in DDPG, the Actor directly maps states to actions (the output of the network directly the output) instead of outputting the probability distribution across a discrete action space"  -<a href="https://towardsdatascience.com/deep-deterministic-policy-gradients-explained-2d94655a9b7b" rel="nofollow noreferrer">towards Data Science</a>  </p>
  
  <p>Deterministic Policy Gradient Algorithms by Silver <em>et al</em>. <a href="http://www0.cs.ucl.ac.uk/staff/d.silver/web/Publications_files/deterministic-policy-gradients.pdf" rel="nofollow noreferrer">PDF</a> </p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-07-05T17:49:32.130Z
Answers.Text: thank you. I also read this from the source but i cant get it. Recently i read a nice tutorial that has implementation and it accurate. On that tutorial there is a line says: "Deterministic policies are used in deterministic environments. These are environments where the actions taken determine the outcome. There is no uncertainty" and this makes me confused! I don't know what I have to do. I read a lot but cant find anything that verify this. i read that here: https://www.freecodecamp.org/news/an-introduction-to-policy-gradients-with-cartpole-and-doom-495b5ef2207f/
Answers.UserDisplayName: Fcoder
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-07-04T03:40:43.130Z
Answers.LastActivityDate: 2019-07-04T15:37:26.920Z
Answers.LastEditDate: 2019-07-04T15:37:26.920Z
Answers.UserDisplayName: S. Phil Kim
Body: <p>I want to develop an AI for continuous space. I reached to DDPG algorithm that takes actions deterministically. </p>
  
  <p>If DDPG takes actions deterministically, should the environment also be deterministic? I want non-deterministic, continuous real-world environments. Is DDPG the algorithm I am looking for? Is there any other algorithm for my need?</p>
  
Tags: <deep-learning><reinforcement-learning><dqn><deep-rl><ddpg>
Title: Is DDPG just for deterministic environments?
UserDisplayName: Fcoder
ThreadText: # Is DDPG just for deterministic environments?
  
  (Asked by: username_0 on 2019-07-03)
  
  I want to develop an AI for continuous space. I reached to DDPG algorithm that takes actions deterministically.
  
  If DDPG takes actions deterministically, should the environment also be deterministic? I want non-deterministic, continuous real-world environments. Is DDPG the algorithm I am looking for? Is there any other algorithm for my need?
  
  **Tags:** deep-learning, reinforcement-learning, dqn, deep-rl, ddpg
  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2019-07-04. Score: 2
  
  I am not an expert in this area. But I believe that the word "Deterministic" is for "Policy" in the "Deterministic Policy" Gradient. It does not mean deterministic environment.
  
  Stochastic policy: Probabilistic(random) action choice for a given state.  
  Deterministic policy: one action is chosen for a given state.
  
  Deterministic Policy Gradient algorithm still can handle a stochastic (and continuous, of cause) environment, but the policy will be deterministic.
  
  Reference
  
  "in DDPG, the Actor directly maps states to actions (the output of the network directly the output) instead of outputting the probability distribution across a discrete action space" -[towards Data Science](https://towardsdatascience.com/deep-deterministic-policy-gradients-explained-2d94655a9b7b)
  
  Deterministic Policy Gradient Algorithms by Silver *et al*. [PDF](http://www0.cs.ucl.ac.uk/staff/d.silver/web/Publications_files/deterministic-policy-gradients.pdf)
  
  > **Comments:**
  > **username_0**: thank you. I also read this from the source but i cant get it. Recently i read a nice tutorial that has implementation and it accurate. On that tutorial there is a line says: "Deterministic policies are used in deterministic environments. These are environments where the actions taken determine the outcome. There is no uncertainty" and this makes me confused! I don't know what I have to do. I read a lot but cant find anything that verify this. i read that here: https://www.freecodecamp.org/news/an-introduction-to-policy-gradients-with-cartpole-and-doom-495b5ef2207f/  
  
  ---
  
  