Solved by albanD in post #2 
              
              
                Hi, 
475MB is most certainly only the cuda initialisation on this device, no Tensor. 
Maybe you want to specify the map_location argument of torch.load when you load your model to avoid initializing the other GPUs. 
Another way is to use CUDA_VISIBLE_DEVICES=2 as an env variable for your script so t…