Viewing RNNs as a generalisation of Markov chains ia a bit confusing, because what you&#x27;re calling a Markov chain isn&#x27;t really a Markov chain in its most general form.<p>The one characteristic a Markov chain must have is that the transition probabilities are completely determined by its current state. This property is true for both RNNs and what you call Markov chains. The main difference is that the state space for RNNs is a lot bigger and better at describing the current context (it was designed to be).