You could push them on the default GPU and add them together:
loss = torch.norm(activation['bottleneck'].to('cuda:0'))

, if you would like to sum them on GPU0.
If this doesn’t work, could you share a small code sample, so that I can have a look?