<p>What is the exact meaning of this expression? I'm unsure on the notation.
I believe E[R(s)] is expected value of reward of state s, but I'm unsure what the subscript under the E means.</p>
<p><a href="https://i.sstatic.net/SKG4e.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/SKG4e.png" alt="enter image description here" /></a></p>

CC BY-SA 4.0
2023-10-14T18:24:27.690Z
Since it would not be helpful for someone to explain something you already know and understand, can you [edit] to be specific about what part of the notation is unclear to you?
Sycorax
CC BY-SA 4.0
2023-10-14T18:57:16.583Z
Thanks for the suggestion. I edited my question
Ryan Marr
CC BY-SA 4.0
2023-10-14T19:11:09.743Z
Great, I think that will help future readers answer this. One more tip is that you can use math typesetting on your posts. More information: https://math.meta.stackexchange.com/questions/5020/mathjax-basic-tutorial-and-quick-reference
Sycorax
<reinforcement-learning><rlhf>
When reading on RLHF, I came across this formula but can't break it down
Ryan Marr
# When reading on RLHF, I came across this formula but can't break it down

(Asked by: username_0 on 2023-10-14)

What is the exact meaning of this expression? I'm unsure on the notation.
I believe E[R(s)] is expected value of reward of state s, but I'm unsure what the subscript under the E means.

[![enter image description here](https://i.sstatic.net/SKG4e.png)](https://i.sstatic.net/SKG4e.png)

**Tags:** reinforcement-learning, rlhf

> **Comments:**
> **username_1**: Since it would not be helpful for someone to explain something you already know and understand, can you [edit] to be specific about what part of the notation is unclear to you?  
> **username_0**: Thanks for the suggestion. I edited my question  
> **username_1**: Great, I think that will help future readers answer this. One more tip is that you can use math typesetting on your posts. More information: https://math.meta.stackexchange.com/questions/5020/mathjax-basic-tutorial-and-quick-reference  

---

## 0 answers

