Also, I have my own dqn code which I put on github: https://github.com/8Gitbrix/DQN 44 . I tested its convergence to a local optimum on the game freeway, but I haven’t ran any rull tests on games since I only have a cpu on my macbook  . If anyone could test it and push the results that would be great.