Solved by JuanFMontesinos in post #2 
              
              
                You are creating h0 but not allocating it on the gpu. 
You need to do (maybe some synthax errors) 
        h0 = torch.zeros(self.num_layers, x.size(0), self.hidden_size,device=x.device).double()
        c0 = torch.zeros(self.num_layers, x.size(0), self.hidden_size,device=x.device).double()

And stil…