Ok… the result looks like this:
>>> import torch
>>> import torch.nn as nn
>>> torch.cuda.device_count()
4
>>> model = nn.Sequential(nn.Linear(10,1)).cuda('cuda:3')
>>> print(model[0].weight.type())
torch.cuda.FloatTensor