See post here:

  
    
    
    Trying to modify this code to use cuda reinforcement-learning
  
  
    Hey Checkout my repo here I implemented a3c with gpu use and hog wild training. I call it A3G and it’s works very well it’s actually even faster at training Atari games than mass parallelized evolutionary algorithms with also much higher overall performance. 


update Just realized you had already visited repo and we spoke on issues on github.  
Guess you can disregard then lol
  


It will be slower if you share gpu to gpu. This way is faster cause you get benefits from gpu and cpu