By default pytorch uses only 1 gpu (device:0). If you want to use multiple gpu’s you need to configure it explicitly.
Here is a simple way to do it : https://pytorch.org/tutorials/beginner/blitz/data_parallel_tutorial.html#create-model-and-dataparallel 81