Hi,
First of all, you should not use .data anymore.
You can use .detach() or torch.no_grad() to replace it.
What is the behavior you expect for the gradients?
Should they be the sum of the gradients for each models? Or should it be only for the first one with the value of the loss changed (so not the true gradients of that model but something else)?