In my program, I have to build two different model for training . However, my cuda memory would be overflowed directly . So I want to distribute training in different GPUs for different models.  My final loss contains of two parts, one part is independent and other is joint.
Dose anybody give me some suggestions ?