Stochastic Process, Markov Chains, Banking.
Markov chain. We could simulate a sample path of X(t) from t=1 to t=12, but that would only give us the profit the bank makes for that particular sample path. To determine the banks expected profit, we could proceed as follows: for each time step determine the probability that the borrow is in