Hidden Markov Models, Markov Chains, Markov Switching, Markov Auto Regression, Maximum Likelihood.
P contains the probabilities of transition to the next state which are conditional upon what is the current state. The state probability vector π_t contains the unconditional probability of being in a certain state at time t. For our 2-step Markov random variable s_t, the state probability