My code is super long and has a bunch of weird stuff going on.  Last time I tried to make a minimal example for something I was not able to.  If it helps this is where that particular parameter is created, which is probably be being done in a weird way.
if(numEpochs > 0):
    values = torch.cat((self.theParameter[numEpochs- 
   1],nn.Parameter(torch.Tensor(1,self.planes).zero_().cuda() + multiplier)),0)
    self.theParameter[numEpochs] = nn.Parameter(values.data.clone().cuda(), requires_grad=True)
self.register_parameter('newestParameter', self.theParameter[numEpochs])
else:
    self.theParameter[0] = nn.Parameter(torch.Tensor(1,self.planes).zero_().cuda().clone(), requires_grad=True)
    self.register_parameter('newestParameter', self.theParameter[numEpochs])

and it is having this problem at the first epoch