Hi,
I’m trying to implement a3c paper myself and learn how to use the package torch.multiprocessing.
What I’m wondering is that when digging in some examples, I saw that we can use simply update the model using optim.step().
However, is it safe to do this? Are all parameters updated simultaneously? If not, we might accidentally use the model to forward while only updating a partial params.