For example,
The network has two outputs, ouput1 is from an intermedia layer and output2 is from the last layer.
And my total loss:
loss_total = loss_1 + loss_2
where loss_1 is calculated using output1 and loss_2 is calculated using output2.
Now the problem is the loss_total seems to be dominated by loss_1 , and loss_2 doesn’t play a role。
I try to put some weights on loss_1, loss_2, like:
loss_total = loss_1 * 0.001 + loss_2 *0.01
However, this is not likely to work.
Does any one has some ideals on the similar problems?