you sum the absolute values of the errors. so your total loss would be 0.5 + 0.4. so, to decrease the total loss it needs to decrease individual losses, thus the gradients are updated such that both the losses decrease simultaneously.
If above is the scenario of your problem, then you can add absolute value of the losses and do backward at once.