Solved by fulltopic in post #4 
              
              
                Seemed the issue has been solved by pytorch-a3c issue#66. The project still failed to work while the problem is beyond this question. 
Sorry for not have been searching for solution efficiently and thank you very much for you help