Markov Decision Process, Reinforcement Learning, Machine Learning, Artificial Intelligence, Game Theory.
Here, we define new states depending on what the agent chose in the previous interaction. This may sound like a hack, but isn’t too far from reality either. You can think of yourself as being on a state in which you are at your current location, and you hold your current beliefs and experiences.