As you forward the composed features (in the variable out) through another fully connected layer you could simply weight them before using torch.cat(). This has however the disadvantage that you don’t know how this will affect the parameters of the fully connected layer during training.
Even if you have to disconnect the networks I would recommend to calculate separate losses.