Could you please elaborate, as  grad(loss) = grad(loss0) + grad(loss1) and these two models have no parameters in common. So they should get same gradients as before when I trained them individually.
I again emphasize that the only difference is that I sum the losses and backpop on the summed loss.