Hi,
I am not sure what you call “double gradient”.
But in this case what will happen is that it will backprop both criterions, then model_2 and once you have all gradients for model_1’s output it will backprop model_1.