Hey @hos-b does model parallelism work in your case? i.e., split your model into two shards and put each shard into one GPU.
If the two GPUs are on the same machine, here is a single-machine model parallel tutorial:

Single-Machine Model Parallel Best Practices — PyTorch Tutorials 1.8.0 documentation

If the two GPUs are on different machines, here are some tutorials on RPC:

RPC: Distributed RPC Framework — PyTorch master documentation 3

tutorials: PyTorch Distributed Overview — PyTorch Tutorials 1.8.0 documentation