I figured it out myself:
All I needed to do is:
def init_hidden(self, bsz):
    weight = next(self.parameters()).data
    a = weight.new(self.nlayers, bsz, 1).normal_(-1,1)
    b = weight.new(self.nlayers, bsz, self.nhid-1).zero_()
    return Variable(torch.cat([a,b], 2))

Thanks for the help