Body: <p>I was recently considering training an agent that perform a task by reinforcement learning. Both the state and actions are continuous, but could be discretized if needed. The problem is that in my case the state observations and reward will be quite noisy, so given the same state and action, the next state and received reward will be different on each run, and the noise cannot be described by canonical probability distributions.</p>
  <p>Up to now I have tried deep Q-network, stochastic policy gradient and deep deterministic policy gradient. While I could successfully implemented these algorithms in the CartPole game, they all failed to learn my particular task.</p>
  <p>I hope to know are there any reinforcement learning methods that can deal with noisy state observations?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-08-01T21:27:00.533Z
Comments.Text: I failed to understand your question. If your rewards are not correlated to the observations by any means, then how would the agent learn?
Comments.UserDisplayName: Yahya
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-08-02T05:25:37.877Z
Comments.Text: @Yahya It is not totally uncorrelated, the state observation and rewards are just corrupted by some noise. As a example, consider letting a human to estimate the distance between him/her and a object. Across different trials the person may report different values even if the actual distance has not changed, but the mean reported distance should be somehow correlated with the actual distance.
Comments.UserDisplayName: Cloudy
Tags: <reinforcement-learning>
Title: Reinforcement learning algorithms that deal with noisy state observations
UserDisplayName: Cloudy
ThreadText: # Reinforcement learning algorithms that deal with noisy state observations
  
  (Asked by: username_0 on 2021-07-31)
  
  I was recently considering training an agent that perform a task by reinforcement learning. Both the state and actions are continuous, but could be discretized if needed. The problem is that in my case the state observations and reward will be quite noisy, so given the same state and action, the next state and received reward will be different on each run, and the noise cannot be described by canonical probability distributions.
  
  Up to now I have tried deep Q-network, stochastic policy gradient and deep deterministic policy gradient. While I could successfully implemented these algorithms in the CartPole game, they all failed to learn my particular task.
  
  I hope to know are there any reinforcement learning methods that can deal with noisy state observations?
  
  **Tags:** reinforcement-learning
  > **Comments:**
  > **username_1**: I failed to understand your question. If your rewards are not correlated to the observations by any means, then how would the agent learn?  
  > **username_0**: @Yahya It is not totally uncorrelated, the state observation and rewards are just corrupted by some noise. As a example, consider letting a human to estimate the distance between him/her and a object. Across different trials the person may report different values even if the actual distance has not changed, but the mean reported distance should be somehow correlated with the actual distance.  
  
  ---
  
  ## 0 answers
  
  