Hi!
So this is an updated question:
How can I get access to which device and what gradient it is computing when using DataParallel?
How would I be able to print
"Device 1: "[ …]
"Device 2: " […]
For the same layer?
Thanks.