Accroding to original A3C, there exist 1 shared global model and multiple local models corresponded to each worker process. A3C is designed for multi-core CPU for parallel processing with poor GPU usage.
With little modification like model.cuda() we can run the model on GPU to speed up training.
[Question]
If we have 2 GPUs in computer. Can we run the A3C just without modification to share the global model between each worker?