Body: <p>What is the exact meaning of this expression? I'm unsure on the notation.
  I believe E[R(s)] is expected value of reward of state s, but I'm unsure what the subscript under the E means.</p>
  <p><a href="https://i.sstatic.net/SKG4e.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/SKG4e.png" alt="enter image description here" /></a></p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2023-10-14T18:24:27.690Z
Comments.Text: Since it would not be helpful for someone to explain something you already know and understand, can you [edit] to be specific about what part of the notation is unclear to you?
Comments.UserDisplayName: Sycorax
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2023-10-14T18:57:16.583Z
Comments.Text: Thanks for the suggestion. I edited my question
Comments.UserDisplayName: Ryan Marr
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2023-10-14T19:11:09.743Z
Comments.Text: Great, I think that will help future readers answer this. One more tip is that you can use math typesetting on your posts. More information: https://math.meta.stackexchange.com/questions/5020/mathjax-basic-tutorial-and-quick-reference
Comments.UserDisplayName: Sycorax
Tags: <reinforcement-learning><rlhf>
Title: When reading on RLHF, I came across this formula but can't break it down
UserDisplayName: Ryan Marr
ThreadText: # When reading on RLHF, I came across this formula but can't break it down
  
  (Asked by: username_0 on 2023-10-14)
  
  What is the exact meaning of this expression? I'm unsure on the notation.
  I believe E[R(s)] is expected value of reward of state s, but I'm unsure what the subscript under the E means.
  
  [![enter image description here](https://i.sstatic.net/SKG4e.png)](https://i.sstatic.net/SKG4e.png)
  
  **Tags:** reinforcement-learning, rlhf
  
  > **Comments:**
  > **username_1**: Since it would not be helpful for someone to explain something you already know and understand, can you [edit] to be specific about what part of the notation is unclear to you?  
  > **username_0**: Thanks for the suggestion. I edited my question  
  > **username_1**: Great, I think that will help future readers answer this. One more tip is that you can use math typesetting on your posts. More information: https://math.meta.stackexchange.com/questions/5020/mathjax-basic-tutorial-and-quick-reference  
  
  ---
  
  ## 0 answers
  
  