You can control where you load your models with .to(device) like you’re already doing. If you only have one GPU or if you specifically select the same device, both of your models will be placed into that device’s memory (as long as they both fit). You can load as many models onto a single device as you wish and they will happily coexist until you’ve filled up the memory on the device.