Hey,
I built Pytorch from source of the current master (https://github.com/pytorch/pytorch/commit/cc3058bdac925dc20ba18b5829f689a67227f753 14) with “Cuda compilation tools, release 8.0, V8.0.61”. (I also tried pytorch v0.2 from binaries with conda)
I also use two 1080TI and as soon as use nn.DataParallel some memory gets allocated, GPU load jumps to 100%, but then  it gets stuck:
from torch import nn
from torch.autograd import Variable
import torch

l = nn.Linear(5,5).cuda()
pl = nn.DataParallel(l)
print("Checkpoint 1")
a = Variable(torch.rand(5,5).cuda(), requires_grad=True)
print("Checkpoint 2")
print(pl(a)) # Here it gets stuck
print("Checkpoint 3")