Algorithms, Dynamic Programming, Machine Learning, Artificial Intelligence, Markov Models.
There is the State Transition Matrix, defining how the state changes over time. If the system is in state s[i] at some time, what is the probability of ending up at state s[j] after one time step? These probabilities are called a(s[i], s[j]). There is the Observation Probability Matrix. If the