In response to #2, I found that line of code from examples/actor_critic.py at master · pytorch/examples · GitHub which I found from Actor Critic implementation problem 1
Since I’m new I can’t post more than 2 links in my post womp womp