Stochastic Process, Markov Chains, Banking.
required. A stochastic process is a family or set of ordered random variables. We will use X(t) to denote the value of the stochastic process at time t. The state space is the set of values that the random variable X(t) can take. The state space and the time set (i.e. the values that t takes) can