Yes you understood right. So I actually have two networks with loss1 from net1 and a loss2 from net2. I want to back-propagate loss1+loss2 to both networks. Do I still need to write custom loss function or could just sum their loss values somehow and compute the gradients based on that?