Outracing champion Gran Turismo drivers with deep reinforcement learning.Many potential applications of artificial intelligence involve making real-time decisions in physical systems while interacting with humans.  Racing simulations, such as the PlayStation game Gran Turismo, faithfully reproduce the non-linear control challenges of real race cars while also encapsulating the complex multi-agent interactions.  Here we describe how we trained agents for Gran Turismo that can compete with the world's best e-sports drivers.  We demonstrate the capabilities of our agent, Gran Turismo Sophy, by winning a head-to-head competition against four of the world's best Gran Turismo drivers. 
Gran Turismo
Outracing champion Gran Turismo drivers with deep reinforcement learning.Many potential applications of artificial intelligence involve making real-time decisions in physical systems while interacting with humans.  We combine state-of-the-art, model-free, deep reinforcement learning algorithms with mixed-scenario training to learn an integrated control policy that combines exceptional speed with impressive tactics. 
deep reinforcement learning