I think, the shouldn’t share parameters (atleast in my experience we separate the parameters heads accordingly to our loss functions)
And usually we just do (loss_1 + loss_2 + .... + loss_n).backward() (or mean/weighted approach etc)