Artificial Intelligence, Reinforcement Learning, Markov Decision Process, AI, Machine Learning.
selecting action a in state s. p(s’,r|s,a): probability of passing from state s to s’ by taking action a and receiving reward r. As you can see, it’s calculated as the weighted sum of immediate rewards and the values of following states, considering transition probabilities and action selection