Here it is:
 the_device=torch.device("gpu:2")
 myModel.to(the_device)

The GPU 2 is supposed to be used solely, but gpu 0 and gpu 2 come into play.  I am not sure what is wrong with my code .
I miss something ?
Thanks in advance for your help