Thanks @albanD  I did this and it did not fix it:
import torch
import torch.nn as nn

torch.backends.cudnn.enabled=False
x = Variable( t.rand(1000000,1).contiguous()).cuda()

print torch.backends.cudnn.version()

bn = nn.BatchNorm1d(1)
bn.cuda()

xbn = bn(x)
xbn.size()