Could you print torch.cuda.device_count()?
Also, could you run the following code, so we can narrow down the issue:
model = nn.Sequential(nn.Linear(10, 1)).cuda('cuda:3')
print(model[0].weight.type())