If I have two networks with the same architecture, say A and B. For security reason, Net B cannot get access to the training data. So I need to train A and update B with A’s gradient.
Note we cannot always copy A to B because A will be updated when training.