Very often agents that deal with partially observable environments need to acquire internal memory to understand what the state of the environment is, and we'll talk extensively when we talk about hidden Markov models about how this structure has such internal memory.