Machine Learning, Robotics, Autonomous Vehicles.
partially observable Markov decision processes (POMDPs). Nonetheless, ordinary Markov decision processes are a helpful place to start when thinking about motion planning. I love the exercises at the end of each chapter of Probabilistic Robotics. There is a fun one called “Heaven or Hell” at the end