I want to train two different models which are too large to be put on the same GPU. But actually the problem is that I need to optimize their total loss at the same time and if they’re on different GPUs, I have trouble in implementing the backpropagation. I have tried different approaches but they didn’t work out. Below is a draft of my experiment architecture. Any suggestion is appreciated. Thanks !!