Hi, thank you for your kind reply. I thought torch.cuda.empty_cache()  will release the context. But I found something even more wired: if I just load the model2 (without loading model1). Two gpus are still used.