Hello guys,
I’m implementing A3C and trying to collect the gradients from individuals models and perform them onto the original model. Say I’ve done this:
outputs = network(inputs)
loss = criterion(outputs, targets)
loss.backward()
What’s next? I only want the gradients of network, but Module doesn’t have gradients method.