Answers.Body: <p>Hyperparameter is an important thing, and it happens everywhere in Machine Learning, not just Deep Reinforcement Learning.</p>
  <p>However, to give you the current state of Deep RL, it is now widely know that Actor-Critic methods such as <a href="https://huggingface.co/blog/deep-rl-a2c" rel="nofollow noreferrer">A2C</a> and <a href="https://openai.com/blog/openai-baselines-ppo/" rel="nofollow noreferrer">PPO</a> are the standard state-of-the-art today, and people generally do not (very) bother with traditional methods anymore (I don't remember how far Andrew NG courses go). Luckily, here's <a href="https://openreview.net/forum?id=nIAxjsniDzg" rel="nofollow noreferrer">a paper</a> that studies how to choose a good hyperparam for Deel RL. The list is very exhaustive though as it's a large-scale study, but it should give you a good starting point.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-01-08T11:17:20.770Z
Answers.LastActivityDate: 2023-01-08T11:17:20.770Z
Answers.UserDisplayName: Minh-Long Luu
Body: <p>I am trying to learn machine learning from Andrew NG's Machine learning specialization on Coursera. In the chapter about reinforcement learning Andrew NG said that if you do not select correct hyperparameters your model can take a long time to train.</p>
  <p>Are there any guidelines on picking hyperparameters for Deep Reinforcement Learning?</p>
  <p>Let's say I have an agent who has 10000 states, how many layers and units my neural network should have? If I am using mini-batches how big should each batch be? If the states are contiguous states, how far back the agent should look before taking a decision?</p>
  
Tags: <neural-networks><reinforcement-learning><deep-rl><hyperparameter-optimization><hyper-parameters>
Title: Are there any guidelines on picking hyperparameters for Deep Reinforcement Learning?
UserDisplayName: EmperorAurelian
ThreadText: # Are there any guidelines on picking hyperparameters for Deep Reinforcement Learning?
  
  (Asked by: username_0 on 2023-01-06)
  
  I am trying to learn machine learning from Andrew NG's Machine learning specialization on Coursera. In the chapter about reinforcement learning Andrew NG said that if you do not select correct hyperparameters your model can take a long time to train.
  
  Are there any guidelines on picking hyperparameters for Deep Reinforcement Learning?
  
  Let's say I have an agent who has 10000 states, how many layers and units my neural network should have? If I am using mini-batches how big should each batch be? If the states are contiguous states, how far back the agent should look before taking a decision?
  
  **Tags:** neural-networks, reinforcement-learning, deep-rl, hyperparameter-optimization, hyper-parameters
  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2023-01-08. Score: 0 | Accepted answer
  
  Hyperparameter is an important thing, and it happens everywhere in Machine Learning, not just Deep Reinforcement Learning.
  
  However, to give you the current state of Deep RL, it is now widely know that Actor-Critic methods such as [A2C](https://huggingface.co/blog/deep-rl-a2c) and [PPO](https://openai.com/blog/openai-baselines-ppo/) are the standard state-of-the-art today, and people generally do not (very) bother with traditional methods anymore (I don't remember how far Andrew NG courses go). Luckily, here's [a paper](https://openreview.net/forum?id=nIAxjsniDzg) that studies how to choose a good hyperparam for Deel RL. The list is very exhaustive though as it's a large-scale study, but it should give you a good starting point.
  
  
  ---
  
  