Hi all,
Let’s say I have a network model and 2 weight files, {W1 and W2}.
The network is initialized with weights W1 and forward pass is performed and loss is computed.
Now, the network weights are switched over to W2 and call to backward() is performed.
Will this compute gradients w.r.t  to W2 or W1?