I have a test,using the offcial example/mnist.
Change the code this way:
From:
model = Net().to(device)
To:
model = Net()
model=nn.DataParallel(model, device_ids=[0, 1]).to(device)
Then run :CUDA_VISIBLE_DEVICES=0,1 python main.py
The same warning came out appear.