umm… that case, loss maybe 0. and Backpropagation doesn’t seem to happen.

The loss being 0 does not imply that gradients are 0 
In particular, if you have final_loss = a_loss - b_loss, the value backproped to each partial loss will be respectively 1 and -1.