during training the network on 8 GPUs in parallel, I am going to manually change the parameters in the network by the following code,
for param in model.parameters():
  param.data.fill_(other parameter)

I am wondering if this would change all the parameters on different GPU or just GPU:0?