Reinforcement Learning, Markov Decision Process, Deep Learning, Machine Learning, Artificial Intelligence.
episodic tasks and sometimes with continuing tasks, but most often with both. So it is convenient to obtain one notation that covers both the cases simultaneously. Equation 1 above, is for episodic tasks while equation 2 is for continuing task. These two can be unified by a scheme as shown in