Multiply the other losses with zero, and then look at the gradients of your model, if it is changing, and if the gradients have a significant magnitude, everything should be working as well as it could be.