By 4 losses, do you mean something like
loss = lambda1*loss1 + lambda2*loss2 + lambda3*loss3 + lambda4*loss4 and scaling the lambda parameters? As a sanity check you can verify that the gradients should be different with lambda4 = 0.