Reinforcement Learning, Markov Decision Process, Markov Chains, Deep Learning, Artificial Intelligence.
state s4 of event e4. Thus mathematically, P(s5|s4) = P(s5|s4,s3,s2,s1) Yes, the vertical line in above equation has the same meaning of conditional probability. Thus s4 is the present state and P(s5|s4) is the probability of occurrence of s5. So the probability of state s5 given s4 has occurred is