Q Function


### value function 
Generalizing Across States - a table of all q-values hard → Too many state → **Generalize that experience to new, similar situations ← Feature-Based Representations**
This is a fundamental idea in machine learning, and we’ll see it over and over again
1. linear value function 
> ![](https://www.notion.so/image/https%3A%2F%2Fs3-us-west-2.amazonaws.com%2Fsecure.notion-static.com%2F6d9e143e-699d-4223-bfcc-e08db89b34d4%2FUntitled.png?table=block&id=0ad0af52-6f54-4591-90e2-329545dab183&cache=v2)
> ![](https://www.notion.so/image/https%3A%2F%2Fs3-us-west-2.amazonaws.com%2Fsecure.notion-static.com%2F1384f9c8-596e-47f0-bd22-4d8cf6ff695a%2FUntitled.png?table=block&id=dc1ca190-b602-4566-bbb0-b878e081173d&cache=v2)
>  + least squares or regression then minimize error
행동가치함수
**어떤 상태에서 어떤 행동이 얼마나 좋은지**





> [(3) 가치함수와 벨만방정식](https://jang-inspiration.com/bellman-equation)





