I think the repos you mentioned solve a different problem. I don’t want to batch the experience collected from the game simulators and do computation on only one GPU. I want to send the gradients over to parameter servers asynchronously, like what Tensorflow’s code 16 is doing conceptually.
The project I’m working on is not exactly A3C or DQN, so I need a more general async GPU skeleton code to work with. But thank you all the same for the links!